Jul 14 12:49:12 devstack cinder-volume[76063]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 14 12:49:12 devstack cinder-volume[76063]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 14 12:49:12 devstack cinder-volume[76063]: we strongly recommend against using it for new projects. Jul 14 12:49:12 devstack cinder-volume[76063]: If you are already using Eventlet, we recommend migrating to a different Jul 14 12:49:12 devstack cinder-volume[76063]: framework. For more detail see Jul 14 12:49:12 devstack cinder-volume[76063]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 14 12:49:12 devstack cinder-volume[76063]: import eventlet # noqa Jul 14 12:49:15 devstack cinder-volume[76063]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76063) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 14 12:49:15 devstack cinder-volume[76063]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76063) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 14 12:49:15 devstack cinder-volume[76063]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76063) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 14 12:49:16 devstack cinder-volume[76063]: INFO dbcounter [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Registered counter for database cinder Jul 14 12:49:16 devstack cinder-volume[76063]: DEBUG oslo_db.sqlalchemy.engines [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76063) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 12:49:16 devstack cinder-volume[76063]: DEBUG dbcounter [-] [76063] Writer thread running {{(pid=76063) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 14 12:49:16 devstack cinder-volume[76063]: INFO cinder.rpc [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 14 12:49:16 devstack cinder-volume[76063]: INFO cinder.rpc [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 14 12:49:16 devstack cinder-volume[76063]: DEBUG oslo_db.sqlalchemy.engines [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76063) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 12:49:16 devstack cinder-volume[76063]: INFO cinder.volume.manager [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Determined volume DB was empty at startup. Jul 14 12:49:16 devstack cinder-volume[76063]: DEBUG cinder.volume.manager [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76063) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 14 12:49:16 devstack cinder-volume[76063]: INFO cinder.volume.manager [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 14 12:49:16 devstack cinder-volume[76063]: WARNING stevedore.named [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 14 12:49:16 devstack cinder-volume[76063]: WARNING castellan.key_manager [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 14 12:49:16 devstack cinder-volume[76063]: WARNING cinder.keymgr.conf_key_mgr [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 14 12:49:16 devstack cinder-volume[76063]: DEBUG cinder.volume.drivers.lvm [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76063) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 14 12:49:16 devstack cinder-volume[76063]: DEBUG oslo_concurrency.processutils [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76063) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_concurrency.processutils [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] CMD "cinder-rtstool verify" returned: 0 in 0.380s {{(pid=76063) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_db.sqlalchemy.engines [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76063) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 12:49:17 devstack cinder-volume[76063]: INFO cinder.rpc [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 14 12:49:17 devstack cinder-volume[76063]: INFO cinder.rpc [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 14 12:49:17 devstack cinder-volume[76063]: WARNING stevedore.named [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 14 12:49:17 devstack cinder-volume[76063]: WARNING castellan.key_manager [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 14 12:49:17 devstack cinder-volume[76063]: INFO cinder.volume.manager [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_db.sqlalchemy.engines [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76063) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 12:49:17 devstack cinder-volume[76063]: INFO oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Starting 1 workers Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Started child 76206 {{(pid=76063) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Full set of CONF: {{(pid=76063) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] ******************************************************************************** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Configuration options gathered from: {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] ================================================================================ {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] allow_availability_zone_fallback = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] allow_compression_on_image_upload = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76206]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] allowed_direct_url_schemes = [] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] api_rate_limit = True {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] auth_strategy = keystone {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] az_cache_duration = 3600 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_availability_zone = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_host = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_name = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_stats_polling_interval = 60 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backup_api_class = cinder.backup.api.API {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backup_name_template = backup-%s {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backup_use_same_host = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backup_use_temp_snapshot = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] chap_password = **** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] chap_username = {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cinder_internal_tenant_project_id = 85ff3e191d0845cfb6972a23802b149f {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cinder_internal_tenant_user_id = 5846246329b34e38a7afe46687ba25e7 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cloned_volume_same_az = True {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cluster = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] compression_format = gzip {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] compute_api_class = cinder.compute.nova.API {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] config_dir = [] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] config_source = [] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] control_exchange = openstack {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] debug = True {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] default_availability_zone = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] default_group_type = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] default_volume_type = lvmdriver-1 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] disk_geometry = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] driver_client_cert = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] driver_client_cert_key = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] driver_data_namespace = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] driver_ssl_cert_path = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] driver_ssl_cert_verify = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] driver_use_ssl = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] enable_force_upload = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] enable_new_services = True {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] enable_unsupported_driver = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] enforce_multipath_for_image_xfer = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] filter_function = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] glance_api_insecure = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] glance_api_servers = ['http://192.168.122.4/image'] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] glance_api_ssl_compression = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] glance_ca_certificates_file = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] glance_catalog_info = image:glance:publicURL {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] glance_certfile = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] glance_keyfile = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] glance_num_retries = 3 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] glance_request_timeout = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] goodness_function = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] graceful_shutdown_timeout = 5 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] group_api_class = cinder.group.api.API {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] host = devstack {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] image_compress_on_upload = True {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] image_conversion_address_space_limit = 1 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] image_conversion_cpu_limit = 60 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] image_conversion_disable = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] image_introspection_address_space_limit = 1 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] image_introspection_cpu_limit = 60 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] image_upload_use_cinder_backend = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] image_upload_use_internal_tenant = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] image_volume_cache_enabled = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] image_volume_cache_max_count = 0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] image_volume_cache_max_size_gb = 0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] init_host_max_objects_retrieval = 0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] instance_format = [instance: %(uuid)s] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] iscsi_target_flags = {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] iscsi_write_cache = on {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] iser_helper = tgtadm {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] iser_ip_address = 192.168.122.4 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] iser_port = 3260 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] log_color = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] log_config_append = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] log_dir = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] log_file = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] log_options = True {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] log_rotate_interval = 1 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76206]: INFO cinder.volume.manager [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] log_rotate_interval_type = days {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] log_rotation_type = none {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] max_age = 0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] max_logfile_count = 30 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] max_logfile_size_mb = 200 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] max_over_subscription_ratio = 20.0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] message_reap_interval = 86400 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] message_ttl = 2592000 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] migration_create_volume_timeout_secs = 300 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] monkey_patch = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] monkey_patch_modules = [] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] my_ip = 192.168.122.4 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] no_snapshot_gb_quota = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] num_iser_scan_tries = 3 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] num_shell_tries = 3 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] num_volume_device_scan_tries = 3 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] nvmeof_conn_info_version = 1 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] nvmet_ns_id = 10 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] nvmet_port_id = 1 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] osapi_max_limit = 1000 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] osapi_volume_ext_list = [] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] osapi_volume_listen_port = 8776 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] osapi_volume_use_ssl = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] osapi_volume_workers = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] per_volume_size_limit = -1 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] periodic_fuzzy_delay = 60 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] periodic_interval = 60 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] public_endpoint = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] publish_errors = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] quota_backup_gigabytes = 1000 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] quota_backups = 10 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] quota_gigabytes = 1000 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] quota_groups = 10 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] quota_snapshots = 10 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] quota_volumes = 10 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] rate_limit_burst = 0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] rate_limit_except_level = CRITICAL {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] rate_limit_interval = 0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] reinit_driver_count = 3 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] replication_device = **** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] report_discard_supported = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] report_interval = 120 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] reservation_clean_interval = 86400 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] reservation_expire = 86400 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] reserved_image_namespaces = [] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] reserved_percentage = 0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] rpc_response_timeout = 120 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] run_external_periodic_tasks = True {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] scst_target_driver = iscsi {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] scst_target_iqn_name = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] service_down_time = 720 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] shell_completion = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] snapshot_name_template = snapshot-%s {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] snapshot_same_host = True {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] split_loggers = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] state_path = /opt/stack/data/cinder {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] storage_availability_zone = nova {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] storage_protocol = iSCSI {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] syslog_log_facility = LOG_USER {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] target_helper = lioadm {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] target_ip_address = 192.168.122.4 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] target_port = 3260 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] target_protocol = iscsi {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] target_secondary_ip_addresses = [] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] trace_flags = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] transport_url = **** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] until_refresh = 0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] use_chap_auth = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] use_default_quota_class = True {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] use_journal = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] use_json = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] use_multipath_for_image_xfer = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] use_stderr = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] use_syslog = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] verify_glance_signatures = enabled {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] volume_api_class = cinder.volume.api.API {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] volume_backend_name = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] volume_clear = zero {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] volume_clear_ionice = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] volume_clear_size = 0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] volume_copy_bps_limit = 0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] volume_dd_blocksize = 1M {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] volume_name_template = volume-%s {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] volume_service_inithost_offload = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] volume_usage_audit_period = month {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] zoning_mode = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_concurrency.disable_process_locking = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.auth_section = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.auth_type = password {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.auth_version = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.cache = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.certfile = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.include_service_catalog = True {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.insecure = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.interface = public {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.keyfile = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.memcache_password = {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.memcache_username = {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.region_name = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.service_type = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.4/identity {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.backend = dogpile.cache.null {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.backend_argument = **** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.backend_expiration_time = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.config_prefix = cache.oslo {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.debug_cache_backend = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.enable_retry_client = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.enable_socket_keepalive = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:17 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.enabled = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.expiration_time = 600 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.hashclient_retry_attempts = 2 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.memcache_dead_retry = 300 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.memcache_pool_maxsize = 10 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.memcache_sasl_enabled = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.password = **** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.proxies = [] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.redis_db = 0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.redis_server = localhost:6379 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.retry_attempts = 2 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.retry_delay = 0.0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.socket_keepalive_count = 1 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.socket_keepalive_idle = 1 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.socket_keepalive_interval = 1 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.socket_timeout = 1.0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.tls_allowed_ciphers = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.tls_cafile = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.tls_certfile = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.tls_enabled = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.tls_keyfile = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cache.username = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] coordination.backend_url = **** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.asyncio_connection = **** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.asyncio_slave_connection = **** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.backend = sqlalchemy {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.connection = **** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.connection_debug = 0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.connection_parameters = {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.connection_recycle_time = 3600 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack sudo[76210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.connection_trace = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.db_inc_retry_interval = True {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.db_max_retries = 20 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack sudo[76210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.db_max_retry_interval = 10 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.db_retry_interval = 1 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.max_overflow = 50 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.max_pool_size = 5 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.max_retries = 10 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.mysql_wsrep_sync_wait = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.pool_timeout = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.retry_interval = 10 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.slave_connection = **** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.sqlite_synchronous = True {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.synchronous_reader = True {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] database.use_db_reconnect = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] profiler.connection_string = messaging:// {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] profiler.enabled = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] profiler.es_doc_type = notification {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] profiler.es_scroll_size = 10000 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] profiler.es_scroll_time = 2m {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] profiler.filter_error_trace = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] profiler.hmac_keys = **** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] profiler.sentinel_service_name = mymaster {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] profiler.socket_timeout = 0.1 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] profiler.trace_requests = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] profiler.trace_sqlalchemy = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] profiler_jaeger.process_tags = {} {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] profiler_jaeger.service_name_prefix = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] profiler_otlp.service_name_prefix = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_policy.enforce_new_defaults = True {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_policy.enforce_scope = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_policy.policy_default_rule = default {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_policy.policy_file = policy.yaml {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] privsep_osbrick.group = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] privsep_osbrick.helper_command = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] privsep_osbrick.user = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cinder_sys_admin.group = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cinder_sys_admin.helper_command = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] cinder_sys_admin.user = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] service_user.auth_section = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] service_user.auth_type = password {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] service_user.cafile = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] service_user.certfile = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] service_user.collect_timing = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] service_user.insecure = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] service_user.keyfile = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] service_user.send_service_user_token = True {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] service_user.split_loggers = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] service_user.timeout = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] glance.auth_section = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] glance.auth_type = password {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] glance.certfile = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] glance.collect_timing = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] glance.insecure = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] glance.keyfile = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] glance.region_name = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] glance.split_loggers = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] glance.timeout = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.backend_availability_zone = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.chap_password = **** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.chap_username = {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.disk_geometry = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.driver_client_cert = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.driver_client_cert_key = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.driver_data_namespace = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.driver_use_ssl = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.extra_capabilities = {} {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.filter_function = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.goodness_function = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.iscsi_target_flags = {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.iscsi_write_cache = on {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.iser_helper = tgtadm {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.iser_ip_address = 192.168.122.4 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.iser_port = 3260 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.lvm_share_target = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.lvm_type = auto {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.num_shell_tries = 3 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.replication_device = **** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.report_discard_supported = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.reserved_percentage = 0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.target_helper = tgtadm {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.target_ip_address = 192.168.122.4 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.target_port = 3260 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.target_protocol = iscsi {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.trace_flags = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.unique_fqdn_network = True {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.use_chap_auth = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.volume_backend_name = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.volume_clear = zero {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.volume_clear_ionice = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.volume_clear_size = 0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_reports.file_event_handler = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_reports.log_dir = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.backend_host = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.chap_password = **** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.chap_username = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.disk_geometry = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.driver_client_cert = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.extra_capabilities = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.filter_function = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.goodness_function = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.iser_helper = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.iser_ip_address = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.iser_port = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.lvm_share_target = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.lvm_type = auto {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.num_shell_tries = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.replication_device = **** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.report_discard_supported = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.reserved_percentage = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.scst_target_driver = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.storage_protocol = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.target_helper = lioadm {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.target_ip_address = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.target_port = 3260 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.trace_flags = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.use_chap_auth = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.volume_clear = zero {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.volume_clear_size = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] lvmdriver-1.volumes_dir = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.ssl = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_notifications.driver = [] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_notifications.retry = -1 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] key_manager.fixed_key = **** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican.barbican_api_version = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican.barbican_endpoint = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican.barbican_endpoint_type = public {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican.barbican_region_name = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican.cafile = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican.certfile = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican.collect_timing = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican.insecure = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican.keyfile = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican.number_of_retries = 60 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican.retry_delay = 1 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican.send_service_user_token = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican.split_loggers = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican.timeout = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican.verify_ssl = True {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican.verify_ssl_path = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican_service_user.auth_section = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican_service_user.auth_type = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican_service_user.cafile = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican_service_user.certfile = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican_service_user.collect_timing = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican_service_user.insecure = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican_service_user.keyfile = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican_service_user.split_loggers = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] barbican_service_user.timeout = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] vault.approle_role_id = **** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] vault.approle_secret_id = **** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] vault.auth_method = approle {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] vault.auth_path = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] vault.kv_mountpoint = secret {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] vault.kv_path = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] vault.kv_version = 2 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] vault.namespace = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] vault.root_token_id = **** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] vault.ssl_ca_crt_file = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] vault.timeout = 60.0 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] vault.token_file = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] vault.token_role = None {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] vault.use_ssl = False {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:49:17 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] ******************************************************************************** {{(pid=76063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 14 12:49:17 devstack sudo[76210]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:17 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:17 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:17 devstack sudo[76213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 12:49:17 devstack sudo[76213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:18 devstack sudo[76213]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:18 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.261s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:18 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 12:49:18 devstack cinder-volume[76206]: INFO cinder.brick.local_dev.lvm [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 14 12:49:18 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:18 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:18 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:18 devstack sudo[76239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 12:49:18 devstack sudo[76239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:18 devstack sudo[76239]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:18 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:18 devstack cinder-volume[76206]: DEBUG cinder.brick.local_dev.lvm [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76206) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 14 12:49:18 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:18 devstack sudo[76365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 12:49:18 devstack sudo[76365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:18 devstack sudo[76365]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:18 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.519s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:18 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:18 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:18 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:18 devstack sudo[76553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 12:49:18 devstack sudo[76553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:19 devstack sudo[76553]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:19 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:19 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:19 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:19 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:19 devstack sudo[76644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 14 12:49:19 devstack sudo[76644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:19 devstack sudo[76644]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:19 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.253s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:19 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:19 devstack sudo[76733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 12:49:19 devstack sudo[76733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:19 devstack sudo[76733]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:19 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:19 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:19 devstack sudo[76822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 12:49:19 devstack sudo[76822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:19 devstack sudo[76822]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:19 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:19 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:19 devstack sudo[76825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 12:49:19 devstack sudo[76825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:20 devstack sudo[76825]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:20 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.358s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:20 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:20 devstack sudo[76908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 12:49:20 devstack sudo[76908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:20 devstack sudo[76908]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:20 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:20 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:20 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:20 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:20 devstack sudo[76915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 12:49:20 devstack sudo[76915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:20 devstack sudo[76915]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:20 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:20 devstack cinder-volume[76206]: INFO cinder.volume.drivers.lvm [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 14 12:49:20 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:20 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:20 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:20 devstack sudo[76972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 12:49:20 devstack sudo[76972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:21 devstack sudo[76972]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:21 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:21 devstack cinder-volume[76206]: DEBUG cinder.volume.drivers.lvm [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Updating volume stats {{(pid=76206) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 12:49:21 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:21 devstack sudo[77006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 12:49:21 devstack sudo[77006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:21 devstack sudo[77006]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:21 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:21 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:21 devstack sudo[77009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 12:49:21 devstack sudo[77009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:21 devstack sudo[77009]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:21 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:21 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:21 devstack sudo[77012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 12:49:21 devstack sudo[77012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:21 devstack sudo[77012]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:21 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:21 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:22 devstack sudo[77015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 12:49:22 devstack sudo[77015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:22 devstack sudo[77015]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:22 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:22 devstack cinder-volume[76206]: INFO cinder.volume.driver [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Driver hasn't implemented _init_vendor_properties() Jul 14 12:49:22 devstack cinder-volume[76206]: DEBUG cinder.volume.driver [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76206) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 14 12:49:22 devstack cinder-volume[76206]: DEBUG oslo_db.sqlalchemy.engines [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76206) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 12:49:22 devstack cinder-volume[76206]: DEBUG dbcounter [-] [76206] Writer thread running {{(pid=76206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 14 12:49:22 devstack cinder-volume[76206]: DEBUG cinder.db.api [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Building query based on filter {{(pid=76206) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 14 12:49:22 devstack cinder-volume[76206]: DEBUG cinder.image.image_utils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76206) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1317}} Jul 14 12:49:22 devstack cinder-volume[76206]: INFO cinder.keymgr.migration [None req-61e1a240-9113-4dda-b0bb-9978cf231eb4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 14 12:49:22 devstack cinder-volume[76206]: DEBUG cinder.volume.drivers.lvm [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Updating volume stats {{(pid=76206) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 12:49:22 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:22 devstack sudo[77018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 12:49:22 devstack sudo[77018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:22 devstack sudo[77018]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:22 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:22 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:22 devstack sudo[77021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 12:49:22 devstack sudo[77021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:22 devstack sudo[77021]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:22 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:22 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:22 devstack sudo[77024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 12:49:22 devstack sudo[77024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:23 devstack sudo[77024]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:23 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:23 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:23 devstack sudo[77035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 12:49:23 devstack sudo[77035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:23 devstack sudo[77035]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:23 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:23 devstack cinder-volume[76206]: DEBUG cinder.manager [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Notifying Schedulers of capabilities ... {{(pid=76206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:49:23 devstack cinder-volume[76206]: INFO cinder.volume.manager [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Driver initialization completed successfully. Jul 14 12:49:23 devstack cinder-volume[76206]: INFO cinder.manager [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Initiating service 2 cleanup Jul 14 12:49:23 devstack cinder-volume[76206]: INFO cinder.manager [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Service 2 cleanup completed. Jul 14 12:49:23 devstack cinder-volume[76206]: DEBUG cinder.service [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Creating RPC server for service cinder-volume {{(pid=76206) start /opt/stack/cinder/cinder/service.py:231}} Jul 14 12:49:23 devstack cinder-volume[76206]: DEBUG cinder.service [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76206) start /opt/stack/cinder/cinder/service.py:237}} Jul 14 12:49:23 devstack cinder-volume[76206]: INFO cinder.volume.manager [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 14 12:49:23 devstack cinder-volume[76206]: DEBUG cinder.volume.drivers.lvm [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Updating volume stats {{(pid=76206) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 12:49:23 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:23 devstack sudo[77038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 12:49:23 devstack sudo[77038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:23 devstack sudo[77038]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:23 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:23 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:23 devstack sudo[77043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 12:49:23 devstack sudo[77043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:24 devstack sudo[77043]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:24 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:24 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:24 devstack sudo[77046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 12:49:24 devstack sudo[77046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:24 devstack sudo[77046]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:24 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:24 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:49:24 devstack sudo[77050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 12:49:24 devstack sudo[77050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:49:24 devstack sudo[77050]: pam_unix(sudo:session): session closed for user root Jul 14 12:49:24 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:49:24 devstack cinder-volume[76206]: INFO cinder.volume.manager [None req-5d39a169-3d12-4a26-91ed-8ef434fe8cc6 None None] Driver post RPC initialization completed successfully. Jul 14 12:49:27 devstack cinder-volume[76063]: DEBUG dbcounter [-] [76063] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76063) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 12:49:34 devstack cinder-volume[76206]: DEBUG dbcounter [-] [76206] Writing DB stats cinder:SELECT=3 {{(pid=76206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 12:49:34 devstack cinder-volume[76206]: DEBUG dbcounter [-] [76206] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 12:49:53 devstack cinder-volume[76206]: DEBUG oslo_service.periodic_task [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running periodic task VolumeManager._thread_info {{(pid=76206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 12:49:53 devstack cinder-volume[76206]: DEBUG cinder.volume.manager [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] thread count: 6 {{(pid=76206) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 12:49:53 devstack cinder-volume[76206]: DEBUG cinder.volume.manager [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] thread info: [<_MainThread(MainThread, started 137366331453568)>, , , , , ] {{(pid=76206) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 12:50:53 devstack cinder-volume[76206]: DEBUG oslo_service.periodic_task [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 12:50:53 devstack cinder-volume[76206]: DEBUG cinder.volume.drivers.lvm [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Updating volume stats {{(pid=76206) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 12:50:53 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:50:53 devstack sudo[79718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 12:50:53 devstack sudo[79718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:50:54 devstack sudo[79718]: pam_unix(sudo:session): session closed for user root Jul 14 12:50:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:50:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:50:54 devstack sudo[79721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 12:50:54 devstack sudo[79721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:50:54 devstack sudo[79721]: pam_unix(sudo:session): session closed for user root Jul 14 12:50:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:50:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:50:54 devstack sudo[79726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 12:50:54 devstack sudo[79726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:50:54 devstack sudo[79726]: pam_unix(sudo:session): session closed for user root Jul 14 12:50:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:50:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:50:54 devstack sudo[79730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 12:50:54 devstack sudo[79730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:50:54 devstack sudo[79730]: pam_unix(sudo:session): session closed for user root Jul 14 12:50:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:50:54 devstack cinder-volume[76206]: DEBUG cinder.manager [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Notifying Schedulers of capabilities ... {{(pid=76206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:50:54 devstack cinder-volume[76206]: DEBUG oslo_service.periodic_task [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running periodic task VolumeManager._thread_info {{(pid=76206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 12:50:54 devstack cinder-volume[76206]: DEBUG cinder.volume.manager [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] thread count: 6 {{(pid=76206) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 12:50:54 devstack cinder-volume[76206]: DEBUG cinder.volume.manager [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] thread info: [<_MainThread(MainThread, started 137366331453568)>, , , , , ] {{(pid=76206) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 12:51:34 devstack cinder-volume[76206]: DEBUG dbcounter [-] [76206] Writing DB stats cinder:SELECT=1 {{(pid=76206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 12:51:34 devstack cinder-volume[76206]: DEBUG dbcounter [-] [76206] Writing DB stats cinder:UPDATE=1 {{(pid=76206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 12:51:53 devstack cinder-volume[76206]: DEBUG oslo_service.periodic_task [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 12:51:53 devstack cinder-volume[76206]: DEBUG cinder.volume.drivers.lvm [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Updating volume stats {{(pid=76206) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 12:51:53 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:51:53 devstack sudo[82711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 12:51:53 devstack sudo[82711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:51:54 devstack sudo[82711]: pam_unix(sudo:session): session closed for user root Jul 14 12:51:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:51:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:51:54 devstack sudo[82714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 12:51:54 devstack sudo[82714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:51:54 devstack sudo[82714]: pam_unix(sudo:session): session closed for user root Jul 14 12:51:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:51:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:51:54 devstack sudo[82720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 12:51:54 devstack sudo[82720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:51:54 devstack sudo[82720]: pam_unix(sudo:session): session closed for user root Jul 14 12:51:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:51:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:51:54 devstack sudo[82723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 12:51:54 devstack sudo[82723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:51:54 devstack sudo[82723]: pam_unix(sudo:session): session closed for user root Jul 14 12:51:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:51:54 devstack cinder-volume[76206]: DEBUG cinder.manager [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Notifying Schedulers of capabilities ... {{(pid=76206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:51:54 devstack cinder-volume[76206]: DEBUG oslo_service.periodic_task [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running periodic task VolumeManager._thread_info {{(pid=76206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 12:51:54 devstack cinder-volume[76206]: DEBUG cinder.volume.manager [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] thread count: 6 {{(pid=76206) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 12:51:54 devstack cinder-volume[76206]: DEBUG cinder.volume.manager [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] thread info: [<_MainThread(MainThread, started 137366331453568)>, , , , , ] {{(pid=76206) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 12:52:53 devstack cinder-volume[76206]: DEBUG oslo_service.periodic_task [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 12:52:53 devstack cinder-volume[76206]: DEBUG cinder.volume.drivers.lvm [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Updating volume stats {{(pid=76206) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 12:52:53 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:52:53 devstack sudo[84955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 12:52:53 devstack sudo[84955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:52:54 devstack sudo[84955]: pam_unix(sudo:session): session closed for user root Jul 14 12:52:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:52:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:52:54 devstack sudo[84958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 12:52:54 devstack sudo[84958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:52:54 devstack sudo[84958]: pam_unix(sudo:session): session closed for user root Jul 14 12:52:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:52:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:52:54 devstack sudo[84966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 12:52:54 devstack sudo[84966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:52:54 devstack sudo[84966]: pam_unix(sudo:session): session closed for user root Jul 14 12:52:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:52:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:52:54 devstack sudo[84970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 12:52:54 devstack sudo[84970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:52:54 devstack sudo[84970]: pam_unix(sudo:session): session closed for user root Jul 14 12:52:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:52:54 devstack cinder-volume[76206]: DEBUG cinder.manager [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Notifying Schedulers of capabilities ... {{(pid=76206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:52:54 devstack cinder-volume[76206]: DEBUG oslo_service.periodic_task [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running periodic task VolumeManager._thread_info {{(pid=76206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 12:52:54 devstack cinder-volume[76206]: DEBUG cinder.volume.manager [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] thread count: 6 {{(pid=76206) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 12:52:54 devstack cinder-volume[76206]: DEBUG cinder.volume.manager [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] thread info: [<_MainThread(MainThread, started 137366331453568)>, , , , , ] {{(pid=76206) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 12:53:34 devstack cinder-volume[76206]: DEBUG dbcounter [-] [76206] Writing DB stats cinder:SELECT=1 {{(pid=76206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 12:53:34 devstack cinder-volume[76206]: DEBUG dbcounter [-] [76206] Writing DB stats cinder:UPDATE=1 {{(pid=76206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 12:53:53 devstack cinder-volume[76206]: DEBUG oslo_service.periodic_task [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 12:53:53 devstack cinder-volume[76206]: DEBUG cinder.volume.drivers.lvm [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Updating volume stats {{(pid=76206) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 12:53:53 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:53:53 devstack sudo[86196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 12:53:53 devstack sudo[86196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:53:54 devstack sudo[86196]: pam_unix(sudo:session): session closed for user root Jul 14 12:53:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:53:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:53:54 devstack sudo[86221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 12:53:54 devstack sudo[86221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:53:54 devstack sudo[86221]: pam_unix(sudo:session): session closed for user root Jul 14 12:53:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:53:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:53:54 devstack sudo[86227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 12:53:54 devstack sudo[86227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:53:54 devstack sudo[86227]: pam_unix(sudo:session): session closed for user root Jul 14 12:53:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:53:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:53:54 devstack sudo[86231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 12:53:54 devstack sudo[86231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:53:54 devstack sudo[86231]: pam_unix(sudo:session): session closed for user root Jul 14 12:53:54 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:53:54 devstack cinder-volume[76206]: DEBUG cinder.manager [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Notifying Schedulers of capabilities ... {{(pid=76206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:53:54 devstack cinder-volume[76206]: DEBUG oslo_service.periodic_task [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] Running periodic task VolumeManager._thread_info {{(pid=76206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 12:53:54 devstack cinder-volume[76206]: DEBUG cinder.volume.manager [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] thread count: 6 {{(pid=76206) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 12:53:54 devstack cinder-volume[76206]: DEBUG cinder.volume.manager [None req-2935f1a9-27fd-467f-a08c-416e562bd489 None None] thread info: [<_MainThread(MainThread, started 137366331453568)>, , , , , ] {{(pid=76206) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 12:53:55 devstack cinder-volume[76063]: INFO oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Caught SIGTERM, stopping children Jul 14 12:53:55 devstack cinder-volume[76063]: DEBUG oslo_concurrency.lockutils [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Acquiring lock "singleton_lock" {{(pid=76063) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 14 12:53:55 devstack cinder-volume[76063]: DEBUG oslo_concurrency.lockutils [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Acquired lock "singleton_lock" {{(pid=76063) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 14 12:53:55 devstack cinder-volume[76063]: DEBUG oslo_concurrency.lockutils [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Releasing lock "singleton_lock" {{(pid=76063) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 14 12:53:55 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Stop services. {{(pid=76063) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 14 12:53:55 devstack cinder-volume[76063]: DEBUG oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Killing children. {{(pid=76063) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 14 12:53:55 devstack cinder-volume[76063]: INFO oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Waiting on 1 children to exit Jul 14 12:53:58 devstack cinder-volume[76206]: DEBUG oslo_concurrency.lockutils [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Acquiring lock "singleton_lock" {{(pid=76206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 14 12:53:58 devstack cinder-volume[76206]: DEBUG oslo_concurrency.lockutils [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Acquired lock "singleton_lock" {{(pid=76206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 14 12:53:58 devstack cinder-volume[76206]: DEBUG oslo_concurrency.lockutils [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Releasing lock "singleton_lock" {{(pid=76206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 14 12:53:58 devstack cinder-volume[76206]: WARNING amqp [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 14 12:53:58 devstack cinder-volume[76206]: WARNING amqp [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 14 12:53:58 devstack cinder-volume[76063]: INFO oslo_service.backend._eventlet.service [None req-97a87e58-6f25-40f1-8055-a8d8a382bcf0 None None] Child 76206 exited with status 0 Jul 14 12:53:59 devstack cinder-volume[86318]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 14 12:53:59 devstack cinder-volume[86318]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 14 12:53:59 devstack cinder-volume[86318]: we strongly recommend against using it for new projects. Jul 14 12:53:59 devstack cinder-volume[86318]: If you are already using Eventlet, we recommend migrating to a different Jul 14 12:53:59 devstack cinder-volume[86318]: framework. For more detail see Jul 14 12:53:59 devstack cinder-volume[86318]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 14 12:53:59 devstack cinder-volume[86318]: import eventlet # noqa Jul 14 12:54:01 devstack cinder-volume[86318]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 14 12:54:01 devstack cinder-volume[86318]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 14 12:54:01 devstack cinder-volume[86318]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 14 12:54:01 devstack cinder-volume[86318]: INFO dbcounter [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Registered counter for database cinder Jul 14 12:54:01 devstack cinder-volume[86318]: DEBUG oslo_db.sqlalchemy.engines [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG dbcounter [-] [86318] Writer thread running {{(pid=86318) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 14 12:54:02 devstack cinder-volume[86318]: INFO cinder.rpc [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 14 12:54:02 devstack cinder-volume[86318]: INFO cinder.rpc [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_db.sqlalchemy.engines [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 12:54:02 devstack cinder-volume[86318]: INFO cinder.volume.manager [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Determined volume DB was empty at startup. Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG cinder.volume.manager [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86318) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 14 12:54:02 devstack cinder-volume[86318]: INFO cinder.volume.manager [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 14 12:54:02 devstack cinder-volume[86318]: WARNING stevedore.named [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 14 12:54:02 devstack cinder-volume[86318]: WARNING castellan.key_manager [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 14 12:54:02 devstack cinder-volume[86318]: WARNING cinder.keymgr.conf_key_mgr [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 14 12:54:02 devstack cinder-volume[86318]: INFO cinder.volume.manager [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_db.sqlalchemy.engines [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 12:54:02 devstack cinder-volume[86318]: INFO oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Starting 1 workers Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Started child 86534 {{(pid=86318) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Full set of CONF: {{(pid=86318) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] ******************************************************************************** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Configuration options gathered from: {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] ================================================================================ {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] allow_availability_zone_fallback = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] allow_compression_on_image_upload = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] allowed_direct_url_schemes = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] api_rate_limit = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] auth_strategy = keystone {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_availability_zone = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86534]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_host = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_stats_polling_interval = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backup_api_class = cinder.backup.api.API {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backup_name_template = backup-%s {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backup_use_same_host = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backup_use_temp_snapshot = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] chap_password = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] chap_username = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cinder_internal_tenant_project_id = 85ff3e191d0845cfb6972a23802b149f {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cinder_internal_tenant_user_id = 5846246329b34e38a7afe46687ba25e7 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cluster = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] compression_format = gzip {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] compute_api_class = cinder.compute.nova.API {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] config_dir = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] config_source = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] control_exchange = openstack {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] debug = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] default_availability_zone = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] default_group_type = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] default_volume_type = QuobyteHD {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] disk_geometry = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] driver_client_cert = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] driver_client_cert_key = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] driver_data_namespace = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] driver_ssl_cert_path = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] driver_ssl_cert_verify = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] driver_use_ssl = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] enable_new_services = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] enable_unsupported_driver = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] enabled_backends = ['QuobyteHD'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] enforce_multipath_for_image_xfer = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] filter_function = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] glance_api_insecure = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] glance_api_servers = ['http://192.168.122.4/image'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] glance_api_ssl_compression = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] glance_ca_certificates_file = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] glance_catalog_info = image:glance:publicURL {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] glance_certfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] glance_keyfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] glance_num_retries = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] glance_request_timeout = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] goodness_function = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] graceful_shutdown_timeout = 5 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] group_api_class = cinder.group.api.API {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] host = devstack {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] image_compress_on_upload = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] image_conversion_address_space_limit = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] image_conversion_cpu_limit = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] image_conversion_disable = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] image_introspection_address_space_limit = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] image_introspection_cpu_limit = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] image_upload_use_cinder_backend = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] image_upload_use_internal_tenant = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] image_volume_cache_enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] image_volume_cache_max_count = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] image_volume_cache_max_size_gb = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] init_host_max_objects_retrieval = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] instance_format = [instance: %(uuid)s] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] iscsi_target_flags = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] iscsi_write_cache = on {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] iser_helper = tgtadm {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Starting volume driver QuobyteDriver (1.1.14) Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] iser_ip_address = 192.168.122.4 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] iser_port = 3260 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] log_color = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] log_config_append = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86534) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] log_dir = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] log_file = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] log_options = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] log_rotate_interval = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] log_rotate_interval_type = days {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] log_rotation_type = none {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] max_age = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] max_logfile_count = 30 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] max_logfile_size_mb = 200 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] max_over_subscription_ratio = 20.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] message_reap_interval = 86400 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] message_ttl = 2592000 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] migration_create_volume_timeout_secs = 300 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] monkey_patch = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] monkey_patch_modules = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] my_ip = 192.168.122.4 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] no_snapshot_gb_quota = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] num_iser_scan_tries = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] num_shell_tries = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] num_volume_device_scan_tries = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] nvmeof_conn_info_version = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] nvmet_ns_id = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] nvmet_port_id = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] osapi_max_limit = 1000 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] osapi_volume_ext_list = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] osapi_volume_listen_port = 8776 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] osapi_volume_use_ssl = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] osapi_volume_workers = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] per_volume_size_limit = -1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] periodic_fuzzy_delay = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] periodic_interval = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] public_endpoint = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] publish_errors = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] quota_backup_gigabytes = 1000 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] quota_backups = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] quota_gigabytes = 1000 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] quota_groups = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] quota_snapshots = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] quota_volumes = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] rate_limit_burst = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] rate_limit_except_level = CRITICAL {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] rate_limit_interval = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] reinit_driver_count = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] replication_device = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] report_discard_supported = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] report_interval = 120 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] reservation_clean_interval = 86400 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] reservation_expire = 86400 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] reserved_image_namespaces = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] reserved_percentage = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] rpc_response_timeout = 120 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] run_external_periodic_tasks = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] scst_target_driver = iscsi {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] scst_target_iqn_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] service_down_time = 720 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] shell_completion = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] snapshot_name_template = snapshot-%s {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] split_loggers = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] state_path = /opt/stack/data/cinder {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] storage_availability_zone = nova {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] storage_protocol = iSCSI {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] syslog_log_facility = LOG_USER {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] target_helper = lioadm {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] target_ip_address = 192.168.122.4 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] target_port = 3260 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] target_protocol = iscsi {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] target_secondary_ip_addresses = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] trace_flags = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] transport_url = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] until_refresh = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] use_chap_auth = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] use_default_quota_class = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] use_journal = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] use_json = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] use_multipath_for_image_xfer = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] use_stderr = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] use_syslog = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] verify_glance_signatures = enabled {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] volume_api_class = cinder.volume.api.API {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] volume_backend_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] volume_clear = zero {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] volume_clear_ionice = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] volume_clear_size = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] volume_copy_bps_limit = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] volume_dd_blocksize = 1M {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] volume_name_template = volume-%s {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] volume_service_inithost_offload = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] volume_usage_audit_period = month {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] zoning_mode = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_concurrency.disable_process_locking = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.auth_section = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.auth_type = password {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.auth_version = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.cache = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.certfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.include_service_catalog = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.insecure = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.interface = public {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.keyfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.memcache_password = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.memcache_username = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.region_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.service_type = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.4/identity {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.backend = dogpile.cache.null {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.backend_argument = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.backend_expiration_time = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.config_prefix = cache.oslo {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.debug_cache_backend = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.enable_retry_client = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.enable_socket_keepalive = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.expiration_time = 600 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.hashclient_retry_attempts = 2 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.memcache_dead_retry = 300 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.memcache_pool_maxsize = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.memcache_sasl_enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.password = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.proxies = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.redis_db = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86534) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 14 12:54:02 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.quobyte [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.redis_server = localhost:6379 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.retry_attempts = 2 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.retry_delay = 0.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.quobyte [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.socket_keepalive_count = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.socket_keepalive_idle = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.socket_keepalive_interval = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.socket_timeout = 1.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.tls_allowed_ciphers = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.tls_cafile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.tls_certfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.tls_enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.tls_keyfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cache.username = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] coordination.backend_url = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.asyncio_connection = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Running cmd (subprocess): mount.quobyte {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.asyncio_slave_connection = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.backend = sqlalchemy {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.connection = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.connection_debug = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.connection_parameters = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.connection_recycle_time = 3600 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.connection_trace = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.db_inc_retry_interval = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.db_max_retries = 20 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.db_max_retry_interval = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.db_retry_interval = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.max_overflow = 50 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.max_pool_size = 5 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.max_retries = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.mysql_wsrep_sync_wait = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.pool_timeout = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.retry_interval = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.slave_connection = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.sqlite_synchronous = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.synchronous_reader = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] database.use_db_reconnect = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] profiler.connection_string = messaging:// {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] profiler.enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] profiler.es_doc_type = notification {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] profiler.es_scroll_size = 10000 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] profiler.es_scroll_time = 2m {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] profiler.filter_error_trace = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] profiler.hmac_keys = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] profiler.sentinel_service_name = mymaster {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] profiler.socket_timeout = 0.1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] profiler.trace_requests = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] profiler.trace_sqlalchemy = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] profiler_jaeger.process_tags = {} {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] profiler_jaeger.service_name_prefix = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] profiler_otlp.service_name_prefix = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_policy.enforce_new_defaults = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_policy.enforce_scope = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_policy.policy_default_rule = default {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_policy.policy_file = policy.yaml {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] privsep_osbrick.group = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] privsep_osbrick.helper_command = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] privsep_osbrick.user = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cinder_sys_admin.group = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cinder_sys_admin.helper_command = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] cinder_sys_admin.user = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] service_user.auth_section = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] service_user.auth_type = password {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] service_user.cafile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] service_user.certfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] service_user.collect_timing = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] service_user.insecure = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] service_user.keyfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] service_user.send_service_user_token = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] service_user.split_loggers = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] service_user.timeout = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] glance.auth_section = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] glance.auth_type = password {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] glance.certfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] glance.collect_timing = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] glance.insecure = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] glance.keyfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] glance.region_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] glance.split_loggers = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] glance.timeout = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.backend_availability_zone = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.chap_password = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.chap_username = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.disk_geometry = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.driver_client_cert = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.driver_client_cert_key = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.driver_data_namespace = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.driver_use_ssl = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.extra_capabilities = {} {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.filter_function = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.goodness_function = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.iscsi_target_flags = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.iscsi_write_cache = on {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.iser_helper = tgtadm {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.iser_ip_address = 192.168.122.4 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.iser_port = 3260 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.nas_host = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.nas_login = admin {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.nas_mount_options = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.nas_password = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.nas_private_key = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.nas_share_path = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.num_shell_tries = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.quobyte_volume_url = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.replication_device = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.report_discard_supported = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.reserved_percentage = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.target_helper = tgtadm {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.target_ip_address = 192.168.122.4 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.target_port = 3260 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack quobyte-client[86538]: Reading configuration file: /etc/quobyte/client.cfg Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.target_protocol = iscsi {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.trace_flags = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.unique_fqdn_network = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.use_chap_auth = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack quobyte-client[86538]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.volume_backend_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.volume_clear = zero {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.volume_clear_ionice = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.volume_clear_size = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_reports.file_event_handler = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_reports.log_dir = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.backend_availability_zone = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.backend_host = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.chap_password = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.chap_username = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.chiscsi_conf = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.disk_geometry = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.driver_client_cert = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.driver_data_namespace = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.driver_use_ssl = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.extra_capabilities = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.filter_function = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.goodness_function = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] CMD "mount.quobyte" returned: 1 in 0.085s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:54:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:54:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:54:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:54:02 devstack cinder-volume[86534]: INFO cinder.volume.drivers.quobyte [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 ... Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 -c /etc/quobyte/client-cinder.cfg {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.iser_helper = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.iser_ip_address = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.iser_port = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.iser_target_prefix = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.nas_host = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.nas_login = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.nas_mount_options = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.nas_password = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.nas_private_key = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.nas_share_path = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.nas_ssh_port = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.num_shell_tries = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.nvmet_port_id = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.replication_device = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.report_discard_supported = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.reserved_percentage = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.scst_target_driver = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.storage_protocol = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.target_helper = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.target_ip_address = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.target_port = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.target_prefix = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.target_protocol = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.trace_flags = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.use_chap_auth = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.volume_clear = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.volume_clear_size = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] QuobyteHD.volumes_dir = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack sudo[86542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 -c /etc/quobyte/client-cinder.cfg Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack sudo[86542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.ssl = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_notifications.driver = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_notifications.retry = -1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] key_manager.fixed_key = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican.barbican_api_version = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican.barbican_endpoint = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican.barbican_endpoint_type = public {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican.barbican_region_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican.cafile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican.certfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican.collect_timing = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican.insecure = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican.keyfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican.number_of_retries = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican.retry_delay = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican.send_service_user_token = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican.split_loggers = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican.timeout = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican.verify_ssl = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican.verify_ssl_path = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican_service_user.auth_section = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican_service_user.auth_type = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican_service_user.cafile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican_service_user.certfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican_service_user.collect_timing = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican_service_user.insecure = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican_service_user.keyfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican_service_user.split_loggers = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] barbican_service_user.timeout = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] vault.approle_role_id = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] vault.approle_secret_id = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] vault.auth_method = approle {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] vault.auth_path = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] vault.kv_mountpoint = secret {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] vault.kv_path = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] vault.kv_version = 2 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] vault.namespace = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] vault.root_token_id = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] vault.ssl_ca_crt_file = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] vault.timeout = 60.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] vault.token_file = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] vault.token_role = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] vault.use_ssl = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:02 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] ******************************************************************************** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 14 12:54:03 devstack sudo[86542]: pam_unix(sudo:session): session closed for user root Jul 14 12:54:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.613s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:54:03 devstack cinder-volume[86534]: INFO cinder.volume.drivers.quobyte [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 succeeded Jul 14 12:54:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:54:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.628s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:54:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:54:03 devstack sudo[86630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:54:03 devstack sudo[86630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:54:03 devstack sudo[86630]: pam_unix(sudo:session): session closed for user root Jul 14 12:54:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.264s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:54:03 devstack cinder-volume[86534]: INFO cinder.volume.driver [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Driver hasn't implemented _init_vendor_properties() Jul 14 12:54:03 devstack cinder-volume[86534]: DEBUG cinder.volume.driver [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86534) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 14 12:54:03 devstack cinder-volume[86534]: DEBUG oslo_db.sqlalchemy.engines [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86534) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 12:54:03 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writer thread running {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 14 12:54:03 devstack cinder-volume[86534]: DEBUG cinder.db.api [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Building query based on filter {{(pid=86534) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 14 12:54:03 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86534) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1317}} Jul 14 12:54:03 devstack cinder-volume[86534]: INFO cinder.keymgr.migration [None req-d655b26e-a3b9-4722-a133-e11ceec96347 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 14 12:54:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:54:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:54:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:54:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:54:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:54:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:54:03 devstack sudo[86636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:54:03 devstack sudo[86636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:54:04 devstack sudo[86636]: pam_unix(sudo:session): session closed for user root Jul 14 12:54:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.319s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:54:04 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:54:04 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Driver initialization completed successfully. Jul 14 12:54:04 devstack cinder-volume[86534]: INFO cinder.manager [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Initiating service 3 cleanup Jul 14 12:54:04 devstack cinder-volume[86534]: INFO cinder.manager [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Service 3 cleanup completed. Jul 14 12:54:04 devstack cinder-volume[86534]: DEBUG cinder.service [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Creating RPC server for service cinder-volume {{(pid=86534) start /opt/stack/cinder/cinder/service.py:231}} Jul 14 12:54:04 devstack cinder-volume[86534]: DEBUG cinder.service [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86534) start /opt/stack/cinder/cinder/service.py:237}} Jul 14 12:54:04 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 14 12:54:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:54:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:54:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:54:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:54:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:54:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:54:04 devstack sudo[86671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:54:04 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:54:05 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root Jul 14 12:54:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.581s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:54:05 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-8dc7466b-c134-4f2e-944f-129aaabd81bb None None] Driver post RPC initialization completed successfully. Jul 14 12:54:07 devstack cinder-volume[86318]: INFO oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Caught SIGTERM, stopping children Jul 14 12:54:07 devstack cinder-volume[86318]: DEBUG oslo_concurrency.lockutils [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Acquiring lock "singleton_lock" {{(pid=86318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 14 12:54:07 devstack cinder-volume[86318]: DEBUG oslo_concurrency.lockutils [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Acquired lock "singleton_lock" {{(pid=86318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 14 12:54:07 devstack cinder-volume[86318]: DEBUG oslo_concurrency.lockutils [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Releasing lock "singleton_lock" {{(pid=86318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 14 12:54:07 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Stop services. {{(pid=86318) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 14 12:54:07 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Killing children. {{(pid=86318) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 14 12:54:07 devstack cinder-volume[86318]: INFO oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Waiting on 1 children to exit Jul 14 12:54:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Acquiring lock "singleton_lock" {{(pid=86534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 14 12:54:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Acquired lock "singleton_lock" {{(pid=86534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 14 12:54:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Releasing lock "singleton_lock" {{(pid=86534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 14 12:54:08 devstack cinder-volume[86534]: WARNING amqp [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 14 12:54:08 devstack cinder-volume[86534]: WARNING amqp [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 14 12:54:08 devstack cinder-volume[86318]: INFO oslo_service.backend._eventlet.service [None req-df479dd6-c156-4ce3-826a-f9370c255446 None None] Child 86534 exited with status 0 Jul 14 12:54:08 devstack cinder-volume[86895]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 14 12:54:08 devstack cinder-volume[86895]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 14 12:54:08 devstack cinder-volume[86895]: we strongly recommend against using it for new projects. Jul 14 12:54:08 devstack cinder-volume[86895]: If you are already using Eventlet, we recommend migrating to a different Jul 14 12:54:08 devstack cinder-volume[86895]: framework. For more detail see Jul 14 12:54:08 devstack cinder-volume[86895]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 14 12:54:08 devstack cinder-volume[86895]: import eventlet # noqa Jul 14 12:54:11 devstack cinder-volume[86895]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86895) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 14 12:54:11 devstack cinder-volume[86895]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86895) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 14 12:54:11 devstack cinder-volume[86895]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86895) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 14 12:54:11 devstack cinder-volume[86895]: INFO dbcounter [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] Registered counter for database cinder Jul 14 12:54:11 devstack cinder-volume[86895]: DEBUG oslo_db.sqlalchemy.engines [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86895) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG dbcounter [-] [86895] Writer thread running {{(pid=86895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 14 12:54:12 devstack cinder-volume[86895]: INFO cinder.rpc [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 14 12:54:12 devstack cinder-volume[86895]: INFO cinder.rpc [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_db.sqlalchemy.engines [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86895) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 12:54:12 devstack cinder-volume[86895]: INFO cinder.volume.manager [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] Determined volume DB was empty at startup. Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG cinder.volume.manager [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86895) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 14 12:54:12 devstack cinder-volume[86895]: WARNING stevedore.named [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 14 12:54:12 devstack cinder-volume[86895]: WARNING castellan.key_manager [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 14 12:54:12 devstack cinder-volume[86895]: WARNING cinder.keymgr.conf_key_mgr [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 14 12:54:12 devstack cinder-volume[86895]: INFO cinder.volume.manager [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_db.sqlalchemy.engines [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86895) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 12:54:12 devstack cinder-volume[86895]: INFO oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] Starting 1 workers Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] Started child 86977 {{(pid=86895) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] Full set of CONF: {{(pid=86895) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] ******************************************************************************** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] Configuration options gathered from: {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] ================================================================================ {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 14 12:54:12 devstack cinder-volume[86977]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] allow_availability_zone_fallback = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] allow_compression_on_image_upload = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] allowed_direct_url_schemes = [] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] api_rate_limit = True {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] auth_strategy = keystone {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_availability_zone = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_host = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_name = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_stats_polling_interval = 60 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backup_api_class = cinder.backup.api.API {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backup_name_template = backup-%s {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backup_use_same_host = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backup_use_temp_snapshot = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] chap_password = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] chap_username = {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cinder_internal_tenant_project_id = 85ff3e191d0845cfb6972a23802b149f {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cinder_internal_tenant_user_id = 5846246329b34e38a7afe46687ba25e7 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cluster = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] compression_format = gzip {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] compute_api_class = cinder.compute.nova.API {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] config_dir = [] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] config_source = [] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] control_exchange = openstack {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] debug = True {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] default_availability_zone = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] default_group_type = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] default_volume_type = QuobyteHD {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] disk_geometry = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] driver_client_cert = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] driver_client_cert_key = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] driver_data_namespace = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] driver_ssl_cert_path = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] driver_ssl_cert_verify = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] driver_use_ssl = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] enable_new_services = True {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] enable_unsupported_driver = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] enabled_backends = ['QuobyteHD'] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] enforce_multipath_for_image_xfer = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] filter_function = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] glance_api_insecure = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] glance_api_servers = ['http://192.168.122.4/image'] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] glance_api_ssl_compression = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] glance_ca_certificates_file = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] glance_catalog_info = image:glance:publicURL {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] glance_certfile = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] glance_keyfile = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] glance_num_retries = 3 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] glance_request_timeout = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] goodness_function = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] graceful_shutdown_timeout = 5 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] group_api_class = cinder.group.api.API {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] host = devstack {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] image_compress_on_upload = True {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] image_conversion_address_space_limit = 1 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] image_conversion_cpu_limit = 60 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] image_conversion_disable = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] image_introspection_address_space_limit = 1 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 14 12:54:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86977) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] image_introspection_cpu_limit = 60 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] image_upload_use_cinder_backend = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] image_upload_use_internal_tenant = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] image_volume_cache_enabled = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] image_volume_cache_max_count = 0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] image_volume_cache_max_size_gb = 0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] init_host_max_objects_retrieval = 0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] instance_format = [instance: %(uuid)s] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] iscsi_target_flags = {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] iscsi_write_cache = on {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] iser_helper = tgtadm {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] iser_ip_address = 192.168.122.4 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] iser_port = 3260 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] log_color = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] log_config_append = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] log_dir = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] log_file = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] log_options = True {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] log_rotate_interval = 1 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] log_rotate_interval_type = days {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] log_rotation_type = none {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] max_age = 0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] max_logfile_count = 30 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] max_logfile_size_mb = 200 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] max_over_subscription_ratio = 20.0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] message_reap_interval = 86400 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] message_ttl = 2592000 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] migration_create_volume_timeout_secs = 300 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] monkey_patch = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] monkey_patch_modules = [] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] my_ip = 192.168.122.4 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] no_snapshot_gb_quota = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] num_iser_scan_tries = 3 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] num_shell_tries = 3 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] num_volume_device_scan_tries = 3 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] nvmeof_conn_info_version = 1 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] nvmet_ns_id = 10 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] nvmet_port_id = 1 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] osapi_max_limit = 1000 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] osapi_volume_ext_list = [] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] osapi_volume_listen = 0.0.0.0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] osapi_volume_listen_port = 8776 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] osapi_volume_use_ssl = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] osapi_volume_workers = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] per_volume_size_limit = -1 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] periodic_fuzzy_delay = 60 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] periodic_interval = 60 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] project_id_regex = [0-9a-f\-]+ {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] public_endpoint = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] publish_errors = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] quota_backup_gigabytes = 1000 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] quota_backups = 10 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] quota_gigabytes = 1000 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] quota_groups = 10 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] quota_snapshots = 10 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] quota_volumes = 10 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] rate_limit_burst = 0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] rate_limit_except_level = CRITICAL {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] rate_limit_interval = 0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] reinit_driver_count = 3 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] replication_device = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] report_discard_supported = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] report_interval = 120 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] reservation_clean_interval = 86400 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] reservation_expire = 86400 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] reserved_image_namespaces = [] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] reserved_percentage = 0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] rpc_response_timeout = 120 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] run_external_periodic_tasks = True {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] scst_target_driver = iscsi {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] scst_target_iqn_name = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] service_down_time = 720 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] shell_completion = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] snapshot_name_template = snapshot-%s {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] split_loggers = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] state_path = /opt/stack/data/cinder {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] storage_availability_zone = nova {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] storage_protocol = iSCSI {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] syslog_log_facility = LOG_USER {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] target_helper = lioadm {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] target_ip_address = 192.168.122.4 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] target_port = 3260 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] target_protocol = iscsi {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] target_secondary_ip_addresses = [] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] trace_flags = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] transfer_api_class = cinder.transfer.api.API {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] transport_url = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] until_refresh = 0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] use_chap_auth = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] use_default_quota_class = True {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] use_journal = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] use_json = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] use_multipath_for_image_xfer = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] use_stderr = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] use_syslog = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] verify_glance_signatures = enabled {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] volume_api_class = cinder.volume.api.API {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] volume_backend_name = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] volume_clear = zero {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] volume_clear_ionice = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] volume_clear_size = 0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] volume_copy_bps_limit = 0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] volume_dd_blocksize = 1M {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] volume_name_template = volume-%s {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] volume_service_inithost_offload = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] volume_usage_audit_period = month {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] zoning_mode = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_concurrency.disable_process_locking = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.auth_section = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.auth_type = password {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.auth_version = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.cache = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86977) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.certfile = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.delay_auth_decision = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.http_connect_timeout = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.include_service_catalog = True {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.insecure = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.interface = public {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.keyfile = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.memcache_password = {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.quobyte [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 14 12:54:12 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.quobyte [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 14 12:54:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Running cmd (subprocess): mount.quobyte {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.memcache_username = {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.region_name = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.service_token_roles_required = True {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.service_type = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.token_cache_time = 300 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.4/identity {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.backend = dogpile.cache.null {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.backend_argument = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.backend_expiration_time = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.config_prefix = cache.oslo {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.debug_cache_backend = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.enable_retry_client = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.enable_socket_keepalive = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.enabled = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.expiration_time = 600 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.hashclient_retry_attempts = 2 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.memcache_dead_retry = 300 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.memcache_pool_maxsize = 10 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.memcache_sasl_enabled = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.password = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.proxies = [] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.redis_db = 0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.redis_sentinel_service_name = mymaster {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.redis_server = localhost:6379 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.retry_attempts = 2 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.retry_delay = 0.0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.socket_keepalive_count = 1 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.socket_keepalive_idle = 1 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.socket_keepalive_interval = 1 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.socket_timeout = 1.0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.tls_allowed_ciphers = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.tls_cafile = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.tls_certfile = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.tls_enabled = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.tls_keyfile = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cache.username = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] coordination.backend_url = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.asyncio_connection = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.asyncio_slave_connection = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.backend = sqlalchemy {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.connection = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.connection_debug = 0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.connection_parameters = {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.connection_recycle_time = 3600 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.connection_trace = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.db_inc_retry_interval = True {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.db_max_retries = 20 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.db_max_retry_interval = 10 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.db_retry_interval = 1 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.max_overflow = 50 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.max_pool_size = 5 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.max_retries = 10 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.mysql_wsrep_sync_wait = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.pool_timeout = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.retry_interval = 10 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.slave_connection = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.sqlite_synchronous = True {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.synchronous_reader = True {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] database.use_db_reconnect = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] profiler.connection_string = messaging:// {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] profiler.enabled = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] profiler.es_doc_type = notification {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] profiler.es_scroll_size = 10000 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] profiler.es_scroll_time = 2m {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] profiler.filter_error_trace = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] profiler.hmac_keys = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] profiler.sentinel_service_name = mymaster {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] profiler.socket_timeout = 0.1 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] profiler.trace_requests = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] profiler.trace_sqlalchemy = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] profiler_jaeger.process_tags = {} {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] profiler_jaeger.service_name_prefix = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] profiler_otlp.service_name_prefix = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_policy.enforce_new_defaults = True {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_policy.enforce_scope = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_policy.policy_default_rule = default {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_policy.policy_file = policy.yaml {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_policy.remote_timeout = 60.0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] privsep_osbrick.group = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] privsep_osbrick.helper_command = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] privsep_osbrick.user = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cinder_sys_admin.group = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cinder_sys_admin.helper_command = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] cinder_sys_admin.user = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] service_user.auth_section = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] service_user.auth_type = password {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] service_user.cafile = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] service_user.certfile = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] service_user.collect_timing = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] service_user.insecure = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] service_user.keyfile = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] service_user.send_service_user_token = True {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] service_user.split_loggers = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] service_user.timeout = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] glance.auth_section = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] glance.auth_type = password {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] glance.certfile = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] glance.collect_timing = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] glance.insecure = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] glance.keyfile = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack quobyte-client[86986]: Reading configuration file: /etc/quobyte/client.cfg Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] glance.region_name = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] glance.split_loggers = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] glance.timeout = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.backend_availability_zone = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack quobyte-client[86986]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.chap_password = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.chap_username = {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.disk_geometry = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.driver_client_cert = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] CMD "mount.quobyte" returned: 1 in 0.053s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.driver_client_cert_key = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.driver_data_namespace = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.driver_use_ssl = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.enable_unsupported_driver = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.extra_capabilities = {} {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.filter_function = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.goodness_function = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.iscsi_target_flags = {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.iscsi_write_cache = on {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.iser_helper = tgtadm {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.iser_ip_address = 192.168.122.4 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.iser_port = 3260 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.nas_host = {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.nas_login = admin {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.nas_mount_options = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.nas_password = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.nas_private_key = {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.nas_share_path = {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.nas_ssh_port = 22 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.num_shell_tries = 3 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.nvmet_port_id = 1 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.quobyte_client_cfg = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.quobyte_volume_url = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.replication_device = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.report_discard_supported = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.reserved_percentage = 0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.scst_target_driver = iscsi {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.scst_target_iqn_name = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.storage_protocol = iSCSI {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.target_helper = tgtadm {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.target_ip_address = 192.168.122.4 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.target_port = 3260 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.target_protocol = iscsi {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.trace_flags = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.unique_fqdn_network = True {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.use_chap_auth = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.volume_backend_name = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.volume_clear = zero {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.volume_clear_ionice = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.volume_clear_size = 0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_reports.file_event_handler = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_reports.log_dir = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.backend_availability_zone = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.backend_host = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.chap_password = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.chap_username = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.chiscsi_conf = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack sudo[86987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.disk_geometry = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.driver_client_cert = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.driver_client_cert_key = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.driver_data_namespace = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.driver_use_ssl = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.extra_capabilities = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.filter_function = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.goodness_function = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.iscsi_target_flags = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.iscsi_write_cache = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.iser_helper = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.iser_ip_address = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.iser_port = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.iser_target_prefix = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.nas_host = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.nas_login = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.nas_mount_options = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.nas_password = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.nas_private_key = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.nas_share_path = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.nas_ssh_port = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.num_shell_tries = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.nvmet_ns_id = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.nvmet_port_id = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.replication_device = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.report_discard_supported = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.reserved_percentage = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.scst_target_driver = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.storage_protocol = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.target_helper = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.target_ip_address = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.target_port = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.target_prefix = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.target_protocol = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.trace_flags = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.unique_fqdn_network = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.use_chap_auth = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.volume_clear = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.volume_clear_ionice = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.volume_clear_size = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] QuobyteHD.volumes_dir = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.ssl = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.ssl_version = {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_notifications.driver = [] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_notifications.retry = -1 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] oslo_messaging_notifications.transport_url = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] key_manager.fixed_key = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican.barbican_api_version = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican.barbican_endpoint = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican.barbican_endpoint_type = public {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican.barbican_region_name = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican.cafile = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican.certfile = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican.collect_timing = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican.insecure = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican.keyfile = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican.number_of_retries = 60 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican.retry_delay = 1 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican.send_service_user_token = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican.split_loggers = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican.timeout = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican.verify_ssl = True {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican.verify_ssl_path = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican_service_user.auth_section = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican_service_user.auth_type = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican_service_user.cafile = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican_service_user.certfile = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican_service_user.collect_timing = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican_service_user.insecure = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican_service_user.keyfile = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican_service_user.split_loggers = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] barbican_service_user.timeout = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] vault.approle_role_id = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] vault.approle_secret_id = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] vault.auth_method = approle {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] vault.auth_path = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] vault.kv_mountpoint = secret {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] vault.kv_path = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] vault.kv_version = 2 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] vault.namespace = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] vault.root_token_id = **** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] vault.ssl_ca_crt_file = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] vault.timeout = 60.0 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] vault.token_file = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] vault.token_role = None {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] vault.use_ssl = False {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 12:54:12 devstack cinder-volume[86895]: DEBUG oslo_service.backend._eventlet.service [None req-30fb096f-3af9-48da-b522-72cd0140cd1f None None] ******************************************************************************** {{(pid=86895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 14 12:54:12 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root Jul 14 12:54:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.225s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:54:12 devstack cinder-volume[86977]: INFO cinder.volume.driver [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Driver hasn't implemented _init_vendor_properties() Jul 14 12:54:12 devstack cinder-volume[86977]: DEBUG cinder.volume.driver [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86977) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 14 12:54:12 devstack cinder-volume[86977]: DEBUG oslo_db.sqlalchemy.engines [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86977) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 12:54:12 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writer thread running {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 14 12:54:12 devstack cinder-volume[86977]: DEBUG cinder.db.api [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Building query based on filter {{(pid=86977) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 14 12:54:12 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86977) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1317}} Jul 14 12:54:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:54:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:54:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:54:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:54:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:54:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:54:12 devstack cinder-volume[86977]: INFO cinder.keymgr.migration [None req-bf80d280-5147-4f33-9b9c-5e57e80bce3d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 14 12:54:12 devstack sudo[86998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:54:12 devstack sudo[86998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:54:13 devstack sudo[86998]: pam_unix(sudo:session): session closed for user root Jul 14 12:54:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.226s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:54:13 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:54:13 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Driver initialization completed successfully. Jul 14 12:54:13 devstack cinder-volume[86977]: INFO cinder.manager [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Initiating service 3 cleanup Jul 14 12:54:13 devstack cinder-volume[86977]: INFO cinder.manager [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Service 3 cleanup completed. Jul 14 12:54:13 devstack cinder-volume[86977]: DEBUG cinder.service [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Creating RPC server for service cinder-volume {{(pid=86977) start /opt/stack/cinder/cinder/service.py:231}} Jul 14 12:54:13 devstack cinder-volume[86977]: DEBUG cinder.service [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86977) start /opt/stack/cinder/cinder/service.py:237}} Jul 14 12:54:13 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 14 12:54:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:54:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:54:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:54:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:54:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:54:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:54:13 devstack sudo[87005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:54:13 devstack sudo[87005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:54:13 devstack sudo[87005]: pam_unix(sudo:session): session closed for user root Jul 14 12:54:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.231s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:54:13 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e33b2d36-bab4-4dc5-bcd4-b1f2b28521a4 None None] Driver post RPC initialization completed successfully. Jul 14 12:54:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 12:54:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 6 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 12:54:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 12:54:22 devstack cinder-volume[86895]: DEBUG dbcounter [-] [86895] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 12:54:22 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 12:54:23 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=4 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 12:55:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 12:55:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:55:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:55:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:55:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:55:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:55:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:55:16 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:55:16 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:55:16 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Jul 14 12:55:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.228s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:55:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:55:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 12:55:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 6 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 12:55:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 12:56:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 12:56:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:56:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:56:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:56:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:56:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:56:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:56:16 devstack sudo[88004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:56:16 devstack sudo[88004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:56:16 devstack sudo[88004]: pam_unix(sudo:session): session closed for user root Jul 14 12:56:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.341s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:56:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:56:21 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 12:56:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Flow 'volume_create_manager' (4b71e892-9380-4f31-92b5-0b9a1e53ca8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:56:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5059bab-6607-4df8-9c38-6264b3bf74ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:56:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5059bab-6607-4df8-9c38-6264b3bf74ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1373400528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f3b24b-e58e-450c-aba2-ba268fc20070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8f7a640f32d4f5bb0ad276e07948917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:56:22Z,use_quota=True,user_id='d3c896eb2f904c6f8d4f348aa39f1e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:56:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b08f4c3-de43-4bb2-a73f-e4af01eb62cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:56:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b08f4c3-de43-4bb2-a73f-e4af01eb62cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:56:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c38b98f-f145-488d-9740-d503e5784d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:56:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c38b98f-f145-488d-9740-d503e5784d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7f3b24b-e58e-450c-aba2-ba268fc20070', 'volume_name': 'volume-d7f3b24b-e58e-450c-aba2-ba268fc20070', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:56:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5bd3110-391f-4905-9eef-9fd7ffe1a096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:56:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5bd3110-391f-4905-9eef-9fd7ffe1a096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:56:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2064bbce-9e7c-49e7-84c7-c9eaa9a75be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:56:21 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Volume d7f3b24b-e58e-450c-aba2-ba268fc20070: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7f3b24b-e58e-450c-aba2-ba268fc20070', 'volume_size': 1} Jul 14 12:56:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:56:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:56:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1373400528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f3b24b-e58e-450c-aba2-ba268fc20070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8f7a640f32d4f5bb0ad276e07948917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:56:22Z,use_quota=True,user_id='d3c896eb2f904c6f8d4f348aa39f1e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 12:56:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Creating volume d7f3b24b-e58e-450c-aba2-ba268fc20070 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 12:56:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:56:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:56:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:56:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:56:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:56:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 12:56:21 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 12:56:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d7f3b24b-e58e-450c-aba2-ba268fc20070 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:56:21 devstack sudo[88059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d7f3b24b-e58e-450c-aba2-ba268fc20070 1073741824 Jul 14 12:56:21 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:56:22 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root Jul 14 12:56:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d7f3b24b-e58e-450c-aba2-ba268fc20070 1073741824" returned: 0 in 0.801s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:56:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d7f3b24b-e58e-450c-aba2-ba268fc20070 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:56:22 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d7f3b24b-e58e-450c-aba2-ba268fc20070 Jul 14 12:56:22 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:56:23 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Jul 14 12:56:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d7f3b24b-e58e-450c-aba2-ba268fc20070" returned: 0 in 0.337s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:56:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 12:56:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:56:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2064bbce-9e7c-49e7-84c7-c9eaa9a75be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7f3b24b-e58e-450c-aba2-ba268fc20070', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:56:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbdd6e77-5e52-491f-913e-c833bed54403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:56:23 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Volume volume-d7f3b24b-e58e-450c-aba2-ba268fc20070 (d7f3b24b-e58e-450c-aba2-ba268fc20070): created successfully Jul 14 12:56:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbdd6e77-5e52-491f-913e-c833bed54403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:56:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Flow 'volume_create_manager' (4b71e892-9380-4f31-92b5-0b9a1e53ca8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:56:23 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-858e13cd-c85e-4ef9-bbb5-cea98bfaca03 tempest-TaggedAttachmentsTest-1647992730 None] Created volume successfully. Jul 14 12:56:32 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 12:56:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Flow 'volume_create_manager' (e18b6d39-867a-4e27-a397-0f1940e7dd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:56:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17afd24-39a7-46c5-8029-70a2228bb573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:56:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17afd24-39a7-46c5-8029-70a2228bb573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1960234835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60edcbad-f2c4-45b6-8057-4c3729ac8494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b5b5e3916b44beac576cfcfcbe4f0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:56:32Z,use_quota=True,user_id='f2e63d894e574fb59f4393230462aa91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:56:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e0a81c-c077-4946-8373-457b8f746046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:56:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e0a81c-c077-4946-8373-457b8f746046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:56:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f19a165-83e8-418f-a1dc-0ea5a41f2f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:56:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f19a165-83e8-418f-a1dc-0ea5a41f2f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60edcbad-f2c4-45b6-8057-4c3729ac8494', 'volume_name': 'volume-60edcbad-f2c4-45b6-8057-4c3729ac8494', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:56:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0751aefb-62e6-4987-b9bb-09426a5be810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:56:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0751aefb-62e6-4987-b9bb-09426a5be810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:56:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3725d155-aed1-42d1-8118-9659dfec0ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:56:32 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Volume 60edcbad-f2c4-45b6-8057-4c3729ac8494: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60edcbad-f2c4-45b6-8057-4c3729ac8494', 'volume_size': 1} Jul 14 12:56:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:56:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:56:32 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1960234835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60edcbad-f2c4-45b6-8057-4c3729ac8494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b5b5e3916b44beac576cfcfcbe4f0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:56:32Z,use_quota=True,user_id='f2e63d894e574fb59f4393230462aa91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 12:56:32 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Creating volume 60edcbad-f2c4-45b6-8057-4c3729ac8494 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 12:56:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:56:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:56:32 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:56:32 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:56:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:56:32 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 12:56:32 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 12:56:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-60edcbad-f2c4-45b6-8057-4c3729ac8494 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:56:32 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-60edcbad-f2c4-45b6-8057-4c3729ac8494 1073741824 Jul 14 12:56:32 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:56:33 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Jul 14 12:56:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-60edcbad-f2c4-45b6-8057-4c3729ac8494 1073741824" returned: 0 in 1.123s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:56:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-60edcbad-f2c4-45b6-8057-4c3729ac8494 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:56:33 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-60edcbad-f2c4-45b6-8057-4c3729ac8494 Jul 14 12:56:33 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:56:34 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Jul 14 12:56:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-60edcbad-f2c4-45b6-8057-4c3729ac8494" returned: 0 in 1.147s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:56:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] <== create_volume: return (2555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 12:56:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.558s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:56:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3725d155-aed1-42d1-8118-9659dfec0ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60edcbad-f2c4-45b6-8057-4c3729ac8494', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:56:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae01dbc-f919-428e-af66-1a8e2e2ed3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:56:34 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Volume volume-60edcbad-f2c4-45b6-8057-4c3729ac8494 (60edcbad-f2c4-45b6-8057-4c3729ac8494): created successfully Jul 14 12:56:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae01dbc-f919-428e-af66-1a8e2e2ed3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:56:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Flow 'volume_create_manager' (e18b6d39-867a-4e27-a397-0f1940e7dd70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:56:35 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-d319767c-b8d4-45ce-a392-43d3846e71b8 tempest-DeleteServersTestJSON-1882020675 None] Created volume successfully. Jul 14 12:56:42 devstack cinder-volume[86977]: WARNING py.warnings [req-68068238-156f-4fc2-a919-37aae811f261 req-8c860f0e-7ea6-4f1d-8f18-eab2c16389aa tempest-DeleteServersTestJSON-1882020675 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 14 12:56:42 devstack cinder-volume[86977]: .first() Jul 14 12:56:42 devstack cinder-volume[86977]: Jul 14 12:56:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-68068238-156f-4fc2-a919-37aae811f261 req-8c860f0e-7ea6-4f1d-8f18-eab2c16389aa tempest-DeleteServersTestJSON-1882020675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:56:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-68068238-156f-4fc2-a919-37aae811f261 req-8c860f0e-7ea6-4f1d-8f18-eab2c16389aa tempest-DeleteServersTestJSON-1882020675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:56:42 devstack cinder-volume[86977]: INFO oslo.privsep.daemon [req-68068238-156f-4fc2-a919-37aae811f261 req-8c860f0e-7ea6-4f1d-8f18-eab2c16389aa tempest-DeleteServersTestJSON-1882020675 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqughyi5b/privsep.sock'] Jul 14 12:56:42 devstack sudo[88738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqughyi5b/privsep.sock Jul 14 12:56:42 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:56:43 devstack cinder-volume[86977]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 14 12:56:43 devstack cinder-volume[86977]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 14 12:56:43 devstack cinder-volume[86977]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 14 12:56:43 devstack cinder-volume[86977]: WARNING oslo.privsep.daemon [-] privsep log: Jul 14 12:56:43 devstack cinder-volume[86977]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 14 12:56:43 devstack cinder-volume[86977]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 14 12:56:43 devstack cinder-volume[86977]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 14 12:56:43 devstack cinder-volume[86977]: WARNING oslo.privsep.daemon [-] privsep log: Jul 14 12:56:43 devstack cinder-volume[86977]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 14 12:56:43 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root Jul 14 12:56:44 devstack cinder-volume[86977]: INFO oslo.privsep.daemon [req-68068238-156f-4fc2-a919-37aae811f261 req-8c860f0e-7ea6-4f1d-8f18-eab2c16389aa tempest-DeleteServersTestJSON-1882020675 None] Spawned new privsep daemon via rootwrap Jul 14 12:56:44 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [req-68068238-156f-4fc2-a919-37aae811f261 req-8c860f0e-7ea6-4f1d-8f18-eab2c16389aa tempest-DeleteServersTestJSON-1882020675 None] Accepted privsep connection to /tmp/tmpqughyi5b/privsep.sock {{(pid=86977) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 14 12:56:44 devstack cinder-volume[86977]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 14 12:56:44 devstack cinder-volume[86977]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 14 12:56:44 devstack cinder-volume[86977]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 14 12:56:44 devstack cinder-volume[86977]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88743 Jul 14 12:56:44 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c8551f-a270-4c7a-a476-85e0eabf337e]: (2,) {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:56:44 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e3221b-e1de-4cfc-883b-06af8bcbe90f]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:56:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-68068238-156f-4fc2-a919-37aae811f261 req-8c860f0e-7ea6-4f1d-8f18-eab2c16389aa tempest-DeleteServersTestJSON-1882020675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-60edcbad-f2c4-45b6-8057-4c3729ac8494 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:56:44 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-60edcbad-f2c4-45b6-8057-4c3729ac8494 Jul 14 12:56:44 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:56:44 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Jul 14 12:56:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-68068238-156f-4fc2-a919-37aae811f261 req-8c860f0e-7ea6-4f1d-8f18-eab2c16389aa tempest-DeleteServersTestJSON-1882020675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-60edcbad-f2c4-45b6-8057-4c3729ac8494" returned: 0 in 0.463s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:56:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-68068238-156f-4fc2-a919-37aae811f261 req-8c860f0e-7ea6-4f1d-8f18-eab2c16389aa tempest-DeleteServersTestJSON-1882020675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.296s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:56:44 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-68068238-156f-4fc2-a919-37aae811f261 req-8c860f0e-7ea6-4f1d-8f18-eab2c16389aa tempest-DeleteServersTestJSON-1882020675 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1', 'name': 'volume-60edcbad-f2c4-45b6-8057-4c3729ac8494', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6987fcb5-72cc-4bd4-a5bc-6290cb791a30', 'enforce_multipath': True} {{(pid=86977) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 12:56:44 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-68068238-156f-4fc2-a919-37aae811f261 req-8c860f0e-7ea6-4f1d-8f18-eab2c16389aa tempest-DeleteServersTestJSON-1882020675 None] attachment_update completed successfully. Jul 14 12:56:49 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-c541a483-1c52-4da6-81c8-d8defe2579cc req-0512d560-b969-4941-8010-38ed980afb9e tempest-DeleteServersTestJSON-1882020675 None] Terminate volume connection completed successfully. Jul 14 12:56:49 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-c541a483-1c52-4da6-81c8-d8defe2579cc req-0512d560-b969-4941-8010-38ed980afb9e tempest-DeleteServersTestJSON-1882020675 None] Deleting attachment 6987fcb5-72cc-4bd4-a5bc-6290cb791a30. {{(pid=86977) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 12:56:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a37f712f-6e17-4eac-8e16-1527b070ca5a tempest-DeleteServersTestJSON-1882020675 None] Acquiring lock "cinder-60edcbad-f2c4-45b6-8057-4c3729ac8494-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:56:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a37f712f-6e17-4eac-8e16-1527b070ca5a tempest-DeleteServersTestJSON-1882020675 None] Lock "cinder-60edcbad-f2c4-45b6-8057-4c3729ac8494-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:56:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a37f712f-6e17-4eac-8e16-1527b070ca5a tempest-DeleteServersTestJSON-1882020675 None] Acquiring lock "cinder-quobyte-60edcbad-f2c4-45b6-8057-4c3729ac8494" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:56:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a37f712f-6e17-4eac-8e16-1527b070ca5a tempest-DeleteServersTestJSON-1882020675 None] Lock "cinder-quobyte-60edcbad-f2c4-45b6-8057-4c3729ac8494" acquired by "delete_volume" :: waited 0.036s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:56:51 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f8fbf0-18a8-4311-8522-7784b52f5e50]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:56:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a37f712f-6e17-4eac-8e16-1527b070ca5a tempest-DeleteServersTestJSON-1882020675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-60edcbad-f2c4-45b6-8057-4c3729ac8494 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:56:51 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-60edcbad-f2c4-45b6-8057-4c3729ac8494 Jul 14 12:56:51 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:56:51 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Jul 14 12:56:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a37f712f-6e17-4eac-8e16-1527b070ca5a tempest-DeleteServersTestJSON-1882020675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-60edcbad-f2c4-45b6-8057-4c3729ac8494" returned: 0 in 0.466s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:56:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a37f712f-6e17-4eac-8e16-1527b070ca5a tempest-DeleteServersTestJSON-1882020675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-60edcbad-f2c4-45b6-8057-4c3729ac8494 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:56:51 devstack sudo[89289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-60edcbad-f2c4-45b6-8057-4c3729ac8494 Jul 14 12:56:51 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:56:52 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root Jul 14 12:56:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a37f712f-6e17-4eac-8e16-1527b070ca5a tempest-DeleteServersTestJSON-1882020675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-60edcbad-f2c4-45b6-8057-4c3729ac8494" returned: 0 in 0.300s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:56:52 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a37f712f-6e17-4eac-8e16-1527b070ca5a tempest-DeleteServersTestJSON-1882020675 None] Lock "cinder-quobyte-60edcbad-f2c4-45b6-8057-4c3729ac8494" released by "delete_volume" :: held 0.831s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:56:52 devstack cinder-volume[86977]: WARNING cinder.quota [None req-a37f712f-6e17-4eac-8e16-1527b070ca5a tempest-DeleteServersTestJSON-1882020675 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 14 12:56:52 devstack cinder-volume[86977]: WARNING cinder.quota [None req-a37f712f-6e17-4eac-8e16-1527b070ca5a tempest-DeleteServersTestJSON-1882020675 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 14 12:56:52 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-a37f712f-6e17-4eac-8e16-1527b070ca5a tempest-DeleteServersTestJSON-1882020675 None] Created reservations ['a6e1392b-3ad8-4e11-85d4-e9fd3f2784ee', 'a3c6beb1-11a6-46a0-b2ed-26ace57adb28', '5aff4144-1238-4e20-9132-99d6051b13d7', '84610896-1145-4360-bd56-3aabc0e1d124'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 12:56:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a37f712f-6e17-4eac-8e16-1527b070ca5a tempest-DeleteServersTestJSON-1882020675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:56:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a37f712f-6e17-4eac-8e16-1527b070ca5a tempest-DeleteServersTestJSON-1882020675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:56:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a37f712f-6e17-4eac-8e16-1527b070ca5a tempest-DeleteServersTestJSON-1882020675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:56:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a37f712f-6e17-4eac-8e16-1527b070ca5a tempest-DeleteServersTestJSON-1882020675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:56:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a37f712f-6e17-4eac-8e16-1527b070ca5a tempest-DeleteServersTestJSON-1882020675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:56:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a37f712f-6e17-4eac-8e16-1527b070ca5a tempest-DeleteServersTestJSON-1882020675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:56:52 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:56:52 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:56:52 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Jul 14 12:56:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a37f712f-6e17-4eac-8e16-1527b070ca5a tempest-DeleteServersTestJSON-1882020675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.314s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:56:52 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-a37f712f-6e17-4eac-8e16-1527b070ca5a tempest-DeleteServersTestJSON-1882020675 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:56:52 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-a37f712f-6e17-4eac-8e16-1527b070ca5a tempest-DeleteServersTestJSON-1882020675 None] Deleted volume successfully. Jul 14 12:56:52 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a37f712f-6e17-4eac-8e16-1527b070ca5a tempest-DeleteServersTestJSON-1882020675 None] Lock "cinder-60edcbad-f2c4-45b6-8057-4c3729ac8494-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:56:59 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 12:56:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Flow 'volume_create_manager' (5bc63477-83cc-4dde-8b95-aeeb3a44e686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:56:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9e13abc-47d9-4254-8224-b3d9b5da8ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:56:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9e13abc-47d9-4254-8224-b3d9b5da8ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2112572171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd74ed1d-49fc-4e7f-a236-eef83649e900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3d9772c83347f099522b94f8db639d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:56:59Z,use_quota=True,user_id='5e36c879f022451dbf6ef9f2d1932176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:56:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f0aef4-5a6f-4e0c-bf95-94ca96a1cbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:56:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f0aef4-5a6f-4e0c-bf95-94ca96a1cbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:56:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69fb319f-38fe-4863-a0e5-8bb48157bf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:56:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69fb319f-38fe-4863-a0e5-8bb48157bf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd74ed1d-49fc-4e7f-a236-eef83649e900', 'volume_name': 'volume-dd74ed1d-49fc-4e7f-a236-eef83649e900', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:56:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd30d5c-abee-444b-a700-b6b23dbdf169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:56:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd30d5c-abee-444b-a700-b6b23dbdf169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:56:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac2f4d2-ac46-48b1-93dd-a421bf725a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:56:59 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Volume dd74ed1d-49fc-4e7f-a236-eef83649e900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd74ed1d-49fc-4e7f-a236-eef83649e900', 'volume_size': 1} Jul 14 12:56:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:56:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:56:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2112572171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd74ed1d-49fc-4e7f-a236-eef83649e900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3d9772c83347f099522b94f8db639d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:56:59Z,use_quota=True,user_id='5e36c879f022451dbf6ef9f2d1932176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 12:56:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Creating volume dd74ed1d-49fc-4e7f-a236-eef83649e900 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 12:56:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:56:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:56:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:56:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:56:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:56:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 12:56:59 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 12:56:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd74ed1d-49fc-4e7f-a236-eef83649e900 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:56:59 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd74ed1d-49fc-4e7f-a236-eef83649e900 1073741824 Jul 14 12:56:59 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:57:00 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Jul 14 12:57:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd74ed1d-49fc-4e7f-a236-eef83649e900 1073741824" returned: 0 in 0.607s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:57:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd74ed1d-49fc-4e7f-a236-eef83649e900 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:57:00 devstack sudo[89369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd74ed1d-49fc-4e7f-a236-eef83649e900 Jul 14 12:57:00 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:57:00 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root Jul 14 12:57:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd74ed1d-49fc-4e7f-a236-eef83649e900" returned: 0 in 0.598s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:57:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 12:57:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:57:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac2f4d2-ac46-48b1-93dd-a421bf725a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd74ed1d-49fc-4e7f-a236-eef83649e900', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:57:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c87336b-cbf7-4ca4-9602-14e57b1d849b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:57:01 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Volume volume-dd74ed1d-49fc-4e7f-a236-eef83649e900 (dd74ed1d-49fc-4e7f-a236-eef83649e900): created successfully Jul 14 12:57:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c87336b-cbf7-4ca4-9602-14e57b1d849b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:57:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Flow 'volume_create_manager' (5bc63477-83cc-4dde-8b95-aeeb3a44e686) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:57:01 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-928a6fc8-05fb-4b59-9390-fc4b57c04f67 tempest-AttachVolumeTestJSON-899158441 None] Created volume successfully. Jul 14 12:57:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-62daf1df-88c2-44e3-b99a-aa3c6deae276 req-e3973813-988a-4f9e-ba73-def65ecc2ab5 tempest-AttachVolumeTestJSON-899158441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:57:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-62daf1df-88c2-44e3-b99a-aa3c6deae276 req-e3973813-988a-4f9e-ba73-def65ecc2ab5 tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:57:03 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac9413f-1094-4914-9990-055836101f7b]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:57:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-62daf1df-88c2-44e3-b99a-aa3c6deae276 req-e3973813-988a-4f9e-ba73-def65ecc2ab5 tempest-AttachVolumeTestJSON-899158441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd74ed1d-49fc-4e7f-a236-eef83649e900 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:57:03 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd74ed1d-49fc-4e7f-a236-eef83649e900 Jul 14 12:57:03 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:57:04 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Jul 14 12:57:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-62daf1df-88c2-44e3-b99a-aa3c6deae276 req-e3973813-988a-4f9e-ba73-def65ecc2ab5 tempest-AttachVolumeTestJSON-899158441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd74ed1d-49fc-4e7f-a236-eef83649e900" returned: 0 in 0.594s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:57:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-62daf1df-88c2-44e3-b99a-aa3c6deae276 req-e3973813-988a-4f9e-ba73-def65ecc2ab5 tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.623s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:57:04 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=21,cinder:UPDATE=20,cinder:DELETE=2,cinder:INSERT=2 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 12:57:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-62daf1df-88c2-44e3-b99a-aa3c6deae276 req-e3973813-988a-4f9e-ba73-def65ecc2ab5 tempest-AttachVolumeTestJSON-899158441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1', 'name': 'volume-dd74ed1d-49fc-4e7f-a236-eef83649e900', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1002bdf9-5f3b-4d68-a214-45e39cf1ace3', 'enforce_multipath': True} {{(pid=86977) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 12:57:04 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-62daf1df-88c2-44e3-b99a-aa3c6deae276 req-e3973813-988a-4f9e-ba73-def65ecc2ab5 tempest-AttachVolumeTestJSON-899158441 None] attachment_update completed successfully. Jul 14 12:57:14 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=4 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 12:57:14 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:UPDATE=21,cinder:SELECT=22,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 12:57:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 12:57:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:57:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:57:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:57:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:57:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:57:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:57:16 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:57:16 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:57:16 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Jul 14 12:57:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.451s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:57:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:57:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 12:57:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 8 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 12:57:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 12:57:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-deb544d7-4520-4da7-9f63-f3157f1edf24 req-5f193f9a-6d95-4429-b701-d44042c7c697 tempest-TaggedAttachmentsTest-1647992730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:57:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-deb544d7-4520-4da7-9f63-f3157f1edf24 req-5f193f9a-6d95-4429-b701-d44042c7c697 tempest-TaggedAttachmentsTest-1647992730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:57:35 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee5d7e2-5b7c-4233-8d6a-04c6269cd383]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:57:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-deb544d7-4520-4da7-9f63-f3157f1edf24 req-5f193f9a-6d95-4429-b701-d44042c7c697 tempest-TaggedAttachmentsTest-1647992730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d7f3b24b-e58e-450c-aba2-ba268fc20070 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:57:35 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d7f3b24b-e58e-450c-aba2-ba268fc20070 Jul 14 12:57:35 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:57:36 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Jul 14 12:57:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-deb544d7-4520-4da7-9f63-f3157f1edf24 req-5f193f9a-6d95-4429-b701-d44042c7c697 tempest-TaggedAttachmentsTest-1647992730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d7f3b24b-e58e-450c-aba2-ba268fc20070" returned: 0 in 0.830s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:57:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-deb544d7-4520-4da7-9f63-f3157f1edf24 req-5f193f9a-6d95-4429-b701-d44042c7c697 tempest-TaggedAttachmentsTest-1647992730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.897s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:57:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-deb544d7-4520-4da7-9f63-f3157f1edf24 req-5f193f9a-6d95-4429-b701-d44042c7c697 tempest-TaggedAttachmentsTest-1647992730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1', 'name': 'volume-d7f3b24b-e58e-450c-aba2-ba268fc20070', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67e1a515-5f14-4694-8eba-632d62b740ec', 'enforce_multipath': True} {{(pid=86977) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 12:57:36 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-deb544d7-4520-4da7-9f63-f3157f1edf24 req-5f193f9a-6d95-4429-b701-d44042c7c697 tempest-TaggedAttachmentsTest-1647992730 None] attachment_update completed successfully. Jul 14 12:57:41 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-d1df9b62-9afd-46c6-80c1-a858f1e1290d req-c7580999-84c4-4f3b-9e6f-5568ba7b34e5 tempest-TaggedAttachmentsTest-1647992730 None] Terminate volume connection completed successfully. Jul 14 12:57:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-d1df9b62-9afd-46c6-80c1-a858f1e1290d req-c7580999-84c4-4f3b-9e6f-5568ba7b34e5 tempest-TaggedAttachmentsTest-1647992730 None] Deleting attachment 67e1a515-5f14-4694-8eba-632d62b740ec. {{(pid=86977) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 12:57:42 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-687fc186-0dd3-408d-8a9d-71f153bafff4 req-3d6cce6c-31fa-46ec-a920-637afeb16007 tempest-AttachVolumeTestJSON-899158441 None] Terminate volume connection completed successfully. Jul 14 12:57:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-687fc186-0dd3-408d-8a9d-71f153bafff4 req-3d6cce6c-31fa-46ec-a920-637afeb16007 tempest-AttachVolumeTestJSON-899158441 None] Deleting attachment 1002bdf9-5f3b-4d68-a214-45e39cf1ace3. {{(pid=86977) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 12:57:51 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 12:57:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Flow 'volume_create_manager' (d4a7abd8-213c-41bd-86fa-ef1618901a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:57:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f71d8a-124d-4bfd-9c38-58fc39362d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:57:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f71d8a-124d-4bfd-9c38-58fc39362d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-56400950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d1500d0-4c9b-47bb-8401-0268f1faab2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3a07195a2a4ebcab481f4102ec29cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:57:51Z,use_quota=True,user_id='dd5e1a4f19ee4058ba4838b3f8571404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:57:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e264ed-f243-4755-95a7-d5fe9bf698d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:57:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e264ed-f243-4755-95a7-d5fe9bf698d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:57:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80521d7b-cfe8-438e-8b0c-7df4dd989b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:57:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80521d7b-cfe8-438e-8b0c-7df4dd989b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d1500d0-4c9b-47bb-8401-0268f1faab2b', 'volume_name': 'volume-4d1500d0-4c9b-47bb-8401-0268f1faab2b', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:57:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04b8d05a-885b-4077-83fd-8e4fa46996e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:57:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04b8d05a-885b-4077-83fd-8e4fa46996e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:57:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34499cf8-a8de-4947-8200-e49277147388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:57:51 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Volume 4d1500d0-4c9b-47bb-8401-0268f1faab2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d1500d0-4c9b-47bb-8401-0268f1faab2b', 'volume_size': 1} Jul 14 12:57:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:57:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:57:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-56400950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d1500d0-4c9b-47bb-8401-0268f1faab2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3a07195a2a4ebcab481f4102ec29cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:57:51Z,use_quota=True,user_id='dd5e1a4f19ee4058ba4838b3f8571404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 12:57:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Creating volume 4d1500d0-4c9b-47bb-8401-0268f1faab2b {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 12:57:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:57:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:57:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:57:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:57:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:57:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 12:57:51 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 12:57:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4d1500d0-4c9b-47bb-8401-0268f1faab2b 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:57:51 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4d1500d0-4c9b-47bb-8401-0268f1faab2b 1073741824 Jul 14 12:57:51 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:57:52 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Jul 14 12:57:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4d1500d0-4c9b-47bb-8401-0268f1faab2b 1073741824" returned: 0 in 0.805s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:57:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4d1500d0-4c9b-47bb-8401-0268f1faab2b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:57:52 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4d1500d0-4c9b-47bb-8401-0268f1faab2b Jul 14 12:57:52 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:57:52 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Jul 14 12:57:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4d1500d0-4c9b-47bb-8401-0268f1faab2b" returned: 0 in 0.379s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:57:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 12:57:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:57:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34499cf8-a8de-4947-8200-e49277147388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d1500d0-4c9b-47bb-8401-0268f1faab2b', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:57:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c59eb4-61b6-4101-b54d-5cbbbcdbc845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:57:52 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Volume volume-4d1500d0-4c9b-47bb-8401-0268f1faab2b (4d1500d0-4c9b-47bb-8401-0268f1faab2b): created successfully Jul 14 12:57:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c59eb4-61b6-4101-b54d-5cbbbcdbc845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:57:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Flow 'volume_create_manager' (d4a7abd8-213c-41bd-86fa-ef1618901a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:57:52 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b5266883-d714-427d-93fa-6e1525bba783 tempest-ServersNegativeTestJSON-1182335823 None] Created volume successfully. Jul 14 12:57:56 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-de346ded-5d31-4682-aa2c-4829add29b60 tempest-TaggedAttachmentsTest-1647992730 None] Acquiring lock "cinder-d7f3b24b-e58e-450c-aba2-ba268fc20070-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:57:56 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-de346ded-5d31-4682-aa2c-4829add29b60 tempest-TaggedAttachmentsTest-1647992730 None] Lock "cinder-d7f3b24b-e58e-450c-aba2-ba268fc20070-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:57:56 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-de346ded-5d31-4682-aa2c-4829add29b60 tempest-TaggedAttachmentsTest-1647992730 None] Acquiring lock "cinder-quobyte-d7f3b24b-e58e-450c-aba2-ba268fc20070" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:57:56 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-de346ded-5d31-4682-aa2c-4829add29b60 tempest-TaggedAttachmentsTest-1647992730 None] Lock "cinder-quobyte-d7f3b24b-e58e-450c-aba2-ba268fc20070" acquired by "delete_volume" :: waited 0.052s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:57:56 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b94e5d-40b5-40f5-8d92-95ef8ba16b9b]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:57:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-de346ded-5d31-4682-aa2c-4829add29b60 tempest-TaggedAttachmentsTest-1647992730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d7f3b24b-e58e-450c-aba2-ba268fc20070 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:57:57 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d7f3b24b-e58e-450c-aba2-ba268fc20070 Jul 14 12:57:57 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:57:57 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-de346ded-5d31-4682-aa2c-4829add29b60 tempest-TaggedAttachmentsTest-1647992730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d7f3b24b-e58e-450c-aba2-ba268fc20070" returned: 0 in 0.572s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-de346ded-5d31-4682-aa2c-4829add29b60 tempest-TaggedAttachmentsTest-1647992730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d7f3b24b-e58e-450c-aba2-ba268fc20070 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 12:57:57 devstack sudo[90896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d7f3b24b-e58e-450c-aba2-ba268fc20070 Jul 14 12:57:57 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Flow 'volume_create_manager' (04493ee7-966b-42b9-a102-445ad154f5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84a86d3-ac54-4200-a375-b90b4d8400ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84a86d3-ac54-4200-a375-b90b4d8400ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1517615452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141773db-51a4-48ab-a9e4-cf1fcf24953f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3a07195a2a4ebcab481f4102ec29cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:57:57Z,use_quota=True,user_id='dd5e1a4f19ee4058ba4838b3f8571404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84540688-4719-4d79-aa32-72e5f3d16b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84540688-4719-4d79-aa32-72e5f3d16b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (673cab51-dd91-46ea-b899-71948f63db66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (673cab51-dd91-46ea-b899-71948f63db66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '141773db-51a4-48ab-a9e4-cf1fcf24953f', 'volume_name': 'volume-141773db-51a4-48ab-a9e4-cf1fcf24953f', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a48646-d936-47b8-91d2-70b63df2e762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a48646-d936-47b8-91d2-70b63df2e762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c2009f-c085-4a31-9fd1-a16979a70483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:57:57 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Volume 141773db-51a4-48ab-a9e4-cf1fcf24953f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-141773db-51a4-48ab-a9e4-cf1fcf24953f', 'volume_size': 1} Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1517615452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141773db-51a4-48ab-a9e4-cf1fcf24953f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3a07195a2a4ebcab481f4102ec29cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:57:57Z,use_quota=True,user_id='dd5e1a4f19ee4058ba4838b3f8571404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Creating volume 141773db-51a4-48ab-a9e4-cf1fcf24953f {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 12:57:57 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-141773db-51a4-48ab-a9e4-cf1fcf24953f 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:57:57 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-141773db-51a4-48ab-a9e4-cf1fcf24953f 1073741824 Jul 14 12:57:57 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:57:57 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-de346ded-5d31-4682-aa2c-4829add29b60 tempest-TaggedAttachmentsTest-1647992730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d7f3b24b-e58e-450c-aba2-ba268fc20070" returned: 0 in 0.533s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:57:57 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-de346ded-5d31-4682-aa2c-4829add29b60 tempest-TaggedAttachmentsTest-1647992730 None] Lock "cinder-quobyte-d7f3b24b-e58e-450c-aba2-ba268fc20070" released by "delete_volume" :: held 1.179s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:57:58 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-de346ded-5d31-4682-aa2c-4829add29b60 tempest-TaggedAttachmentsTest-1647992730 None] Created reservations ['edb522d8-38fc-472e-8a03-05bd127eb062', 'c7729a24-9c8f-4492-8276-b865b0338d63', '74be56a5-beb7-4777-a8fb-a7a1e9f1b02f', '279115dc-e07e-4f6e-9004-e4b8748328be'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 12:57:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-de346ded-5d31-4682-aa2c-4829add29b60 tempest-TaggedAttachmentsTest-1647992730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:57:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-de346ded-5d31-4682-aa2c-4829add29b60 tempest-TaggedAttachmentsTest-1647992730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:57:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-de346ded-5d31-4682-aa2c-4829add29b60 tempest-TaggedAttachmentsTest-1647992730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:57:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-de346ded-5d31-4682-aa2c-4829add29b60 tempest-TaggedAttachmentsTest-1647992730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:57:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-de346ded-5d31-4682-aa2c-4829add29b60 tempest-TaggedAttachmentsTest-1647992730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:57:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-de346ded-5d31-4682-aa2c-4829add29b60 tempest-TaggedAttachmentsTest-1647992730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:57:58 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:57:58 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:57:58 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Jul 14 12:57:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-141773db-51a4-48ab-a9e4-cf1fcf24953f 1073741824" returned: 0 in 0.830s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:57:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-141773db-51a4-48ab-a9e4-cf1fcf24953f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:57:58 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-141773db-51a4-48ab-a9e4-cf1fcf24953f Jul 14 12:57:58 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:57:58 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Jul 14 12:57:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-de346ded-5d31-4682-aa2c-4829add29b60 tempest-TaggedAttachmentsTest-1647992730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.486s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:57:58 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-de346ded-5d31-4682-aa2c-4829add29b60 tempest-TaggedAttachmentsTest-1647992730 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:57:58 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-de346ded-5d31-4682-aa2c-4829add29b60 tempest-TaggedAttachmentsTest-1647992730 None] Deleted volume successfully. Jul 14 12:57:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-de346ded-5d31-4682-aa2c-4829add29b60 tempest-TaggedAttachmentsTest-1647992730 None] Lock "cinder-d7f3b24b-e58e-450c-aba2-ba268fc20070-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:57:58 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Jul 14 12:57:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-141773db-51a4-48ab-a9e4-cf1fcf24953f" returned: 0 in 0.374s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:57:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 12:57:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:57:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c2009f-c085-4a31-9fd1-a16979a70483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-141773db-51a4-48ab-a9e4-cf1fcf24953f', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:57:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a820aef-d2f1-4991-9e4c-b7d5787d2dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:57:58 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Volume volume-141773db-51a4-48ab-a9e4-cf1fcf24953f (141773db-51a4-48ab-a9e4-cf1fcf24953f): created successfully Jul 14 12:57:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a820aef-d2f1-4991-9e4c-b7d5787d2dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:57:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Flow 'volume_create_manager' (04493ee7-966b-42b9-a102-445ad154f5c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:57:58 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-91815dbf-0530-475d-aed5-cb6b45b33e91 tempest-ServersNegativeTestJSON-1182335823 None] Created volume successfully. Jul 14 12:58:01 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-03e10137-2d6a-43fb-b826-98bb3dc7e340 tempest-ServersNegativeTestJSON-1182335823 None] Acquiring lock "cinder-141773db-51a4-48ab-a9e4-cf1fcf24953f-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:58:01 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-03e10137-2d6a-43fb-b826-98bb3dc7e340 tempest-ServersNegativeTestJSON-1182335823 None] Lock "cinder-141773db-51a4-48ab-a9e4-cf1fcf24953f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:58:01 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-03e10137-2d6a-43fb-b826-98bb3dc7e340 tempest-ServersNegativeTestJSON-1182335823 None] Acquiring lock "cinder-quobyte-141773db-51a4-48ab-a9e4-cf1fcf24953f" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:58:01 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-03e10137-2d6a-43fb-b826-98bb3dc7e340 tempest-ServersNegativeTestJSON-1182335823 None] Lock "cinder-quobyte-141773db-51a4-48ab-a9e4-cf1fcf24953f" acquired by "delete_volume" :: waited 0.038s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:58:01 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dfb1c9-6c01-49d0-aee9-94df09891eef]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:58:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-03e10137-2d6a-43fb-b826-98bb3dc7e340 tempest-ServersNegativeTestJSON-1182335823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-141773db-51a4-48ab-a9e4-cf1fcf24953f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:01 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-141773db-51a4-48ab-a9e4-cf1fcf24953f Jul 14 12:58:01 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:01 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-03e10137-2d6a-43fb-b826-98bb3dc7e340 tempest-ServersNegativeTestJSON-1182335823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-141773db-51a4-48ab-a9e4-cf1fcf24953f" returned: 0 in 0.549s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-03e10137-2d6a-43fb-b826-98bb3dc7e340 tempest-ServersNegativeTestJSON-1182335823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-141773db-51a4-48ab-a9e4-cf1fcf24953f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:02 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-141773db-51a4-48ab-a9e4-cf1fcf24953f Jul 14 12:58:02 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:02 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-03e10137-2d6a-43fb-b826-98bb3dc7e340 tempest-ServersNegativeTestJSON-1182335823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-141773db-51a4-48ab-a9e4-cf1fcf24953f" returned: 0 in 0.321s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-03e10137-2d6a-43fb-b826-98bb3dc7e340 tempest-ServersNegativeTestJSON-1182335823 None] Lock "cinder-quobyte-141773db-51a4-48ab-a9e4-cf1fcf24953f" released by "delete_volume" :: held 0.938s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:58:02 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-03e10137-2d6a-43fb-b826-98bb3dc7e340 tempest-ServersNegativeTestJSON-1182335823 None] Created reservations ['6d978159-5350-45f0-b0ad-f13a1e9fbd5a', '515b6795-86c4-4fdd-8799-c07d7bcbcb97', '69cb15a7-57f7-4682-8e3d-931e877cff7f', 'fc51912b-c901-4bb2-9344-bbad45270c34'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 12:58:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-03e10137-2d6a-43fb-b826-98bb3dc7e340 tempest-ServersNegativeTestJSON-1182335823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:58:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-03e10137-2d6a-43fb-b826-98bb3dc7e340 tempest-ServersNegativeTestJSON-1182335823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:58:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-03e10137-2d6a-43fb-b826-98bb3dc7e340 tempest-ServersNegativeTestJSON-1182335823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:58:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-03e10137-2d6a-43fb-b826-98bb3dc7e340 tempest-ServersNegativeTestJSON-1182335823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:58:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-03e10137-2d6a-43fb-b826-98bb3dc7e340 tempest-ServersNegativeTestJSON-1182335823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:58:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-03e10137-2d6a-43fb-b826-98bb3dc7e340 tempest-ServersNegativeTestJSON-1182335823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:02 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:58:02 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d1d678cb-de99-4fc6-8d45-1d8d50e07235 tempest-ServersNegativeTestJSON-1182335823 None] Acquiring lock "cinder-4d1500d0-4c9b-47bb-8401-0268f1faab2b-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:58:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d1d678cb-de99-4fc6-8d45-1d8d50e07235 tempest-ServersNegativeTestJSON-1182335823 None] Lock "cinder-4d1500d0-4c9b-47bb-8401-0268f1faab2b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:58:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d1d678cb-de99-4fc6-8d45-1d8d50e07235 tempest-ServersNegativeTestJSON-1182335823 None] Acquiring lock "cinder-quobyte-4d1500d0-4c9b-47bb-8401-0268f1faab2b" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:58:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d1d678cb-de99-4fc6-8d45-1d8d50e07235 tempest-ServersNegativeTestJSON-1182335823 None] Lock "cinder-quobyte-4d1500d0-4c9b-47bb-8401-0268f1faab2b" acquired by "delete_volume" :: waited 0.044s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:58:02 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[4860d308-b4c2-45c1-932e-e74ec02ef7c0]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:58:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d1d678cb-de99-4fc6-8d45-1d8d50e07235 tempest-ServersNegativeTestJSON-1182335823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4d1500d0-4c9b-47bb-8401-0268f1faab2b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:02 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4d1500d0-4c9b-47bb-8401-0268f1faab2b Jul 14 12:58:02 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:03 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-03e10137-2d6a-43fb-b826-98bb3dc7e340 tempest-ServersNegativeTestJSON-1182335823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.572s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:03 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-03e10137-2d6a-43fb-b826-98bb3dc7e340 tempest-ServersNegativeTestJSON-1182335823 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:58:03 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-03e10137-2d6a-43fb-b826-98bb3dc7e340 tempest-ServersNegativeTestJSON-1182335823 None] Deleted volume successfully. Jul 14 12:58:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-03e10137-2d6a-43fb-b826-98bb3dc7e340 tempest-ServersNegativeTestJSON-1182335823 None] Lock "cinder-141773db-51a4-48ab-a9e4-cf1fcf24953f-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:58:03 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d1d678cb-de99-4fc6-8d45-1d8d50e07235 tempest-ServersNegativeTestJSON-1182335823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4d1500d0-4c9b-47bb-8401-0268f1faab2b" returned: 0 in 0.445s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d1d678cb-de99-4fc6-8d45-1d8d50e07235 tempest-ServersNegativeTestJSON-1182335823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4d1500d0-4c9b-47bb-8401-0268f1faab2b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:03 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4d1500d0-4c9b-47bb-8401-0268f1faab2b Jul 14 12:58:03 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:03 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d1d678cb-de99-4fc6-8d45-1d8d50e07235 tempest-ServersNegativeTestJSON-1182335823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4d1500d0-4c9b-47bb-8401-0268f1faab2b" returned: 0 in 0.408s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d1d678cb-de99-4fc6-8d45-1d8d50e07235 tempest-ServersNegativeTestJSON-1182335823 None] Lock "cinder-quobyte-4d1500d0-4c9b-47bb-8401-0268f1faab2b" released by "delete_volume" :: held 0.937s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:58:03 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-d1d678cb-de99-4fc6-8d45-1d8d50e07235 tempest-ServersNegativeTestJSON-1182335823 None] Created reservations ['1f2217f7-361b-4448-b008-5c36a398cff7', '09239ec7-0568-4ac8-99f4-b4a453d1a49c', '6d801cef-6556-4020-bd1b-3e8e7f8caa16', 'b6242f72-0bd1-458f-8380-ab363e635ead'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 12:58:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d1d678cb-de99-4fc6-8d45-1d8d50e07235 tempest-ServersNegativeTestJSON-1182335823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:58:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d1d678cb-de99-4fc6-8d45-1d8d50e07235 tempest-ServersNegativeTestJSON-1182335823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:58:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d1d678cb-de99-4fc6-8d45-1d8d50e07235 tempest-ServersNegativeTestJSON-1182335823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:58:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d1d678cb-de99-4fc6-8d45-1d8d50e07235 tempest-ServersNegativeTestJSON-1182335823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:58:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d1d678cb-de99-4fc6-8d45-1d8d50e07235 tempest-ServersNegativeTestJSON-1182335823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:58:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d1d678cb-de99-4fc6-8d45-1d8d50e07235 tempest-ServersNegativeTestJSON-1182335823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:04 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:58:04 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:04 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d1d678cb-de99-4fc6-8d45-1d8d50e07235 tempest-ServersNegativeTestJSON-1182335823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.359s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:04 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-d1d678cb-de99-4fc6-8d45-1d8d50e07235 tempest-ServersNegativeTestJSON-1182335823 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:58:04 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-d1d678cb-de99-4fc6-8d45-1d8d50e07235 tempest-ServersNegativeTestJSON-1182335823 None] Deleted volume successfully. Jul 14 12:58:04 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d1d678cb-de99-4fc6-8d45-1d8d50e07235 tempest-ServersNegativeTestJSON-1182335823 None] Lock "cinder-4d1500d0-4c9b-47bb-8401-0268f1faab2b-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:58:14 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 12:58:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Flow 'volume_create_manager' (9765f6af-d838-4bf0-862f-dad955510696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:58:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c87b49-97e7-4aba-bd11-57bb50ca33b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:58:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c87b49-97e7-4aba-bd11-57bb50ca33b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-59878817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b04064-8322-439d-8d54-f00300959342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e407b61ca0e648ed87e9113eba82da4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:58:14Z,use_quota=True,user_id='fb46788384c3421999a4e6c26fcf3abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:58:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dc825e7-45d8-4072-b90c-2ee9033c48bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:58:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dc825e7-45d8-4072-b90c-2ee9033c48bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:58:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ceb450b-2e3d-476f-8bff-738847d50500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:58:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ceb450b-2e3d-476f-8bff-738847d50500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42b04064-8322-439d-8d54-f00300959342', 'volume_name': 'volume-42b04064-8322-439d-8d54-f00300959342', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:58:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c438e841-15b3-4e20-9945-fbc8e9e73949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:58:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c438e841-15b3-4e20-9945-fbc8e9e73949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:58:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75069dd0-a4b7-452d-af25-ae2716f6a203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:58:14 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Volume 42b04064-8322-439d-8d54-f00300959342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42b04064-8322-439d-8d54-f00300959342', 'volume_size': 1} Jul 14 12:58:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:58:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:58:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-59878817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b04064-8322-439d-8d54-f00300959342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e407b61ca0e648ed87e9113eba82da4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:58:14Z,use_quota=True,user_id='fb46788384c3421999a4e6c26fcf3abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 12:58:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Creating volume 42b04064-8322-439d-8d54-f00300959342 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 12:58:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:58:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:58:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:58:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:58:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:58:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 12:58:14 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 12:58:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-42b04064-8322-439d-8d54-f00300959342 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:14 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-42b04064-8322-439d-8d54-f00300959342 1073741824 Jul 14 12:58:14 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:15 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-42b04064-8322-439d-8d54-f00300959342 1073741824" returned: 0 in 0.720s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-42b04064-8322-439d-8d54-f00300959342 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:15 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-42b04064-8322-439d-8d54-f00300959342 Jul 14 12:58:15 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:15 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-42b04064-8322-439d-8d54-f00300959342" returned: 0 in 0.290s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 12:58:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:58:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75069dd0-a4b7-452d-af25-ae2716f6a203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42b04064-8322-439d-8d54-f00300959342', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:58:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7780a72-71a5-4ccf-8d34-54a932fec5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:58:15 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Volume volume-42b04064-8322-439d-8d54-f00300959342 (42b04064-8322-439d-8d54-f00300959342): created successfully Jul 14 12:58:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7780a72-71a5-4ccf-8d34-54a932fec5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:58:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Flow 'volume_create_manager' (9765f6af-d838-4bf0-862f-dad955510696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:58:15 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-4eb9132e-e4c5-4533-b206-0ab23cd75e39 tempest-VolumesAdminNegativeTest-990383300 None] Created volume successfully. Jul 14 12:58:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 12:58:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:58:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:58:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:58:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:58:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:58:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:16 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:58:16 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:17 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.608s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:17 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:58:17 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 12:58:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 8 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 12:58:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 12:58:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-981a0d0a-447a-457a-9d02-447ee90d81e3 tempest-VolumesAdminNegativeTest-990383300 None] Acquiring lock "cinder-42b04064-8322-439d-8d54-f00300959342-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:58:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-981a0d0a-447a-457a-9d02-447ee90d81e3 tempest-VolumesAdminNegativeTest-990383300 None] Lock "cinder-42b04064-8322-439d-8d54-f00300959342-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:58:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-981a0d0a-447a-457a-9d02-447ee90d81e3 tempest-VolumesAdminNegativeTest-990383300 None] Acquiring lock "cinder-quobyte-42b04064-8322-439d-8d54-f00300959342" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:58:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-981a0d0a-447a-457a-9d02-447ee90d81e3 tempest-VolumesAdminNegativeTest-990383300 None] Lock "cinder-quobyte-42b04064-8322-439d-8d54-f00300959342" acquired by "delete_volume" :: waited 0.033s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:58:18 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb22f1a-2129-4e61-87d3-88b604a68571]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:58:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-981a0d0a-447a-457a-9d02-447ee90d81e3 tempest-VolumesAdminNegativeTest-990383300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-42b04064-8322-439d-8d54-f00300959342 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:18 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-42b04064-8322-439d-8d54-f00300959342 Jul 14 12:58:18 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:18 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-981a0d0a-447a-457a-9d02-447ee90d81e3 tempest-VolumesAdminNegativeTest-990383300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-42b04064-8322-439d-8d54-f00300959342" returned: 0 in 0.652s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-981a0d0a-447a-457a-9d02-447ee90d81e3 tempest-VolumesAdminNegativeTest-990383300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-42b04064-8322-439d-8d54-f00300959342 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:18 devstack sudo[91134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-42b04064-8322-439d-8d54-f00300959342 Jul 14 12:58:18 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:19 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-981a0d0a-447a-457a-9d02-447ee90d81e3 tempest-VolumesAdminNegativeTest-990383300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-42b04064-8322-439d-8d54-f00300959342" returned: 0 in 0.603s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-981a0d0a-447a-457a-9d02-447ee90d81e3 tempest-VolumesAdminNegativeTest-990383300 None] Lock "cinder-quobyte-42b04064-8322-439d-8d54-f00300959342" released by "delete_volume" :: held 1.356s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:58:19 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-981a0d0a-447a-457a-9d02-447ee90d81e3 tempest-VolumesAdminNegativeTest-990383300 None] Created reservations ['203721b1-f2cc-4be5-980a-1deddbd88a05', '823fc7d0-a888-4946-b42f-b05d91330fd6', '5cd5aaed-d921-45bf-88cf-fa4391c34e7a', '40671827-e86c-4f58-a93b-a91d12fd6509'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 12:58:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-981a0d0a-447a-457a-9d02-447ee90d81e3 tempest-VolumesAdminNegativeTest-990383300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:58:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-981a0d0a-447a-457a-9d02-447ee90d81e3 tempest-VolumesAdminNegativeTest-990383300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:58:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-981a0d0a-447a-457a-9d02-447ee90d81e3 tempest-VolumesAdminNegativeTest-990383300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:58:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-981a0d0a-447a-457a-9d02-447ee90d81e3 tempest-VolumesAdminNegativeTest-990383300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:58:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-981a0d0a-447a-457a-9d02-447ee90d81e3 tempest-VolumesAdminNegativeTest-990383300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:58:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-981a0d0a-447a-457a-9d02-447ee90d81e3 tempest-VolumesAdminNegativeTest-990383300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:19 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:58:19 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:19 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-981a0d0a-447a-457a-9d02-447ee90d81e3 tempest-VolumesAdminNegativeTest-990383300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.338s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:19 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-981a0d0a-447a-457a-9d02-447ee90d81e3 tempest-VolumesAdminNegativeTest-990383300 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:58:19 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-981a0d0a-447a-457a-9d02-447ee90d81e3 tempest-VolumesAdminNegativeTest-990383300 None] Deleted volume successfully. Jul 14 12:58:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-981a0d0a-447a-457a-9d02-447ee90d81e3 tempest-VolumesAdminNegativeTest-990383300 None] Lock "cinder-42b04064-8322-439d-8d54-f00300959342-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:58:22 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 12:58:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Flow 'volume_create_manager' (367f3559-c11f-4705-8c8a-33bf51909e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:58:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f25ca1-8dd3-4018-8d0f-48e996cd0859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:58:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f25ca1-8dd3-4018-8d0f-48e996cd0859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1610743879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03bed8b-ce11-4526-9f00-7ea78dcc799d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcd2c4a1d6354acc81e62f842a0a8682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:58:23Z,use_quota=True,user_id='3b6b717f0559469eb5e46fd41e1f2801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:58:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e3a951-d3e6-4a02-9ce2-91d9bdfedf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:58:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e3a951-d3e6-4a02-9ce2-91d9bdfedf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:58:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746c9187-5ed5-4c0b-8b84-11e8fe8125d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:58:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746c9187-5ed5-4c0b-8b84-11e8fe8125d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd03bed8b-ce11-4526-9f00-7ea78dcc799d', 'volume_name': 'volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:58:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4694fd39-92a4-4ec7-945a-e0e61e9f75ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:58:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4694fd39-92a4-4ec7-945a-e0e61e9f75ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:58:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7dd8ff-54fa-43d0-a768-1ff367947ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:58:23 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Volume d03bed8b-ce11-4526-9f00-7ea78dcc799d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d', 'volume_size': 1} Jul 14 12:58:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:58:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:58:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1610743879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03bed8b-ce11-4526-9f00-7ea78dcc799d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcd2c4a1d6354acc81e62f842a0a8682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:58:23Z,use_quota=True,user_id='3b6b717f0559469eb5e46fd41e1f2801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 12:58:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Creating volume d03bed8b-ce11-4526-9f00-7ea78dcc799d {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 12:58:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:58:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:58:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:58:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:58:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:58:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 12:58:23 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 12:58:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:23 devstack sudo[91170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d 1073741824 Jul 14 12:58:23 devstack sudo[91170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:23 devstack sudo[91170]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d 1073741824" returned: 0 in 0.628s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:23 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d Jul 14 12:58:23 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:23 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d" returned: 0 in 0.292s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 12:58:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:58:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7dd8ff-54fa-43d0-a768-1ff367947ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:58:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32cc08e3-b17f-4c53-95a5-1360e2447b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:58:24 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Volume volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d (d03bed8b-ce11-4526-9f00-7ea78dcc799d): created successfully Jul 14 12:58:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32cc08e3-b17f-4c53-95a5-1360e2447b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:58:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Flow 'volume_create_manager' (367f3559-c11f-4705-8c8a-33bf51909e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:58:24 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-70205b7d-743b-494f-8b9d-c6c0d3786e13 req-0af817ae-7462-4a07-b1aa-7dbf1e94ff7f tempest-VolumesSnapshotsTestJSON-819802978 None] Created volume successfully. Jul 14 12:58:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-be0ee4e9-e2ee-47a7-8116-e3a52f163356 req-b7789fd8-23f9-4e8a-8a5e-6abebef1e24b tempest-VolumesSnapshotsTestJSON-819802978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:58:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-be0ee4e9-e2ee-47a7-8116-e3a52f163356 req-b7789fd8-23f9-4e8a-8a5e-6abebef1e24b tempest-VolumesSnapshotsTestJSON-819802978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:58:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [req-be0ee4e9-e2ee-47a7-8116-e3a52f163356 req-b7789fd8-23f9-4e8a-8a5e-6abebef1e24b tempest-VolumesSnapshotsTestJSON-819802978 None] Creating offline snapshot 220fcd9f-68d3-43ed-8994-93a0cc7c46fd of volume d03bed8b-ce11-4526-9f00-7ea78dcc799d {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 12:58:25 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[179894f0-bd40-46ef-a354-3748a19b07b2]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:58:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-be0ee4e9-e2ee-47a7-8116-e3a52f163356 req-b7789fd8-23f9-4e8a-8a5e-6abebef1e24b tempest-VolumesSnapshotsTestJSON-819802978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:25 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d Jul 14 12:58:25 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:25 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-be0ee4e9-e2ee-47a7-8116-e3a52f163356 req-b7789fd8-23f9-4e8a-8a5e-6abebef1e24b tempest-VolumesSnapshotsTestJSON-819802978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d" returned: 0 in 0.400s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-be0ee4e9-e2ee-47a7-8116-e3a52f163356 req-b7789fd8-23f9-4e8a-8a5e-6abebef1e24b tempest-VolumesSnapshotsTestJSON-819802978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.220fcd9f-68d3-43ed-8994-93a0cc7c46fd 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:25 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.220fcd9f-68d3-43ed-8994-93a0cc7c46fd 1G Jul 14 12:58:25 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:26 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-be0ee4e9-e2ee-47a7-8116-e3a52f163356 req-b7789fd8-23f9-4e8a-8a5e-6abebef1e24b tempest-VolumesSnapshotsTestJSON-819802978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.220fcd9f-68d3-43ed-8994-93a0cc7c46fd 1G" returned: 0 in 0.482s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-be0ee4e9-e2ee-47a7-8116-e3a52f163356 req-b7789fd8-23f9-4e8a-8a5e-6abebef1e24b tempest-VolumesSnapshotsTestJSON-819802978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.220fcd9f-68d3-43ed-8994-93a0cc7c46fd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:26 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.220fcd9f-68d3-43ed-8994-93a0cc7c46fd Jul 14 12:58:26 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:26 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-be0ee4e9-e2ee-47a7-8116-e3a52f163356 req-b7789fd8-23f9-4e8a-8a5e-6abebef1e24b tempest-VolumesSnapshotsTestJSON-819802978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.220fcd9f-68d3-43ed-8994-93a0cc7c46fd" returned: 0 in 0.324s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:26 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [req-be0ee4e9-e2ee-47a7-8116-e3a52f163356 req-b7789fd8-23f9-4e8a-8a5e-6abebef1e24b tempest-VolumesSnapshotsTestJSON-819802978 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.220fcd9f-68d3-43ed-8994-93a0cc7c46fd is being set with open permissions: ugo+rw Jul 14 12:58:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-be0ee4e9-e2ee-47a7-8116-e3a52f163356 req-b7789fd8-23f9-4e8a-8a5e-6abebef1e24b tempest-VolumesSnapshotsTestJSON-819802978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.220fcd9f-68d3-43ed-8994-93a0cc7c46fd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:26 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.220fcd9f-68d3-43ed-8994-93a0cc7c46fd Jul 14 12:58:26 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:27 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-be0ee4e9-e2ee-47a7-8116-e3a52f163356 req-b7789fd8-23f9-4e8a-8a5e-6abebef1e24b tempest-VolumesSnapshotsTestJSON-819802978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.220fcd9f-68d3-43ed-8994-93a0cc7c46fd" returned: 0 in 0.360s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-be0ee4e9-e2ee-47a7-8116-e3a52f163356 req-b7789fd8-23f9-4e8a-8a5e-6abebef1e24b tempest-VolumesSnapshotsTestJSON-819802978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:27 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.info Jul 14 12:58:27 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:27 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-be0ee4e9-e2ee-47a7-8116-e3a52f163356 req-b7789fd8-23f9-4e8a-8a5e-6abebef1e24b tempest-VolumesSnapshotsTestJSON-819802978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.info" returned: 0 in 0.276s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:27 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [req-be0ee4e9-e2ee-47a7-8116-e3a52f163356 req-b7789fd8-23f9-4e8a-8a5e-6abebef1e24b tempest-VolumesSnapshotsTestJSON-819802978 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.info is being set with open permissions: ugo+rw Jul 14 12:58:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-be0ee4e9-e2ee-47a7-8116-e3a52f163356 req-b7789fd8-23f9-4e8a-8a5e-6abebef1e24b tempest-VolumesSnapshotsTestJSON-819802978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:27 devstack sudo[91205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.info Jul 14 12:58:27 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:27 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-be0ee4e9-e2ee-47a7-8116-e3a52f163356 req-b7789fd8-23f9-4e8a-8a5e-6abebef1e24b tempest-VolumesSnapshotsTestJSON-819802978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.info" returned: 0 in 0.252s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-be0ee4e9-e2ee-47a7-8116-e3a52f163356 req-b7789fd8-23f9-4e8a-8a5e-6abebef1e24b tempest-VolumesSnapshotsTestJSON-819802978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.222s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:58:27 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-be0ee4e9-e2ee-47a7-8116-e3a52f163356 req-b7789fd8-23f9-4e8a-8a5e-6abebef1e24b tempest-VolumesSnapshotsTestJSON-819802978 None] Create snapshot completed successfully Jul 14 12:58:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] Acquiring lock "cinder-220fcd9f-68d3-43ed-8994-93a0cc7c46fd-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:58:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] Lock "cinder-220fcd9f-68d3-43ed-8994-93a0cc7c46fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:58:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] Acquiring lock "cinder-quobyte-d03bed8b-ce11-4526-9f00-7ea78dcc799d" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:58:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] Lock "cinder-quobyte-d03bed8b-ce11-4526-9f00-7ea78dcc799d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:58:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] Acquiring lock "cinder-quobyte-220fcd9f-68d3-43ed-8994-93a0cc7c46fd" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:58:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] Lock "cinder-quobyte-220fcd9f-68d3-43ed-8994-93a0cc7c46fd" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:58:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] Deleting offline snapshot 220fcd9f-68d3-43ed-8994-93a0cc7c46fd of volume d03bed8b-ce11-4526-9f00-7ea78dcc799d {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 12:58:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] snapshot_file for this snap is: volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.220fcd9f-68d3-43ed-8994-93a0cc7c46fd {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 12:58:28 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4fc7b8-ff20-4028-a755-6b173b59fa63]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:58:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.220fcd9f-68d3-43ed-8994-93a0cc7c46fd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:28 devstack sudo[91208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.220fcd9f-68d3-43ed-8994-93a0cc7c46fd Jul 14 12:58:28 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:28 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.220fcd9f-68d3-43ed-8994-93a0cc7c46fd" returned: 0 in 0.531s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 12:58:28 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd26adc-e745-43a7-8be6-1a06c1b4dae1]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:58:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:28 devstack sudo[91217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d Jul 14 12:58:28 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:29 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d" returned: 0 in 0.498s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.220fcd9f-68d3-43ed-8994-93a0cc7c46fd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:29 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.220fcd9f-68d3-43ed-8994-93a0cc7c46fd Jul 14 12:58:29 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:29 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.220fcd9f-68d3-43ed-8994-93a0cc7c46fd" returned: 0 in 0.437s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.220fcd9f-68d3-43ed-8994-93a0cc7c46fd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:29 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.220fcd9f-68d3-43ed-8994-93a0cc7c46fd Jul 14 12:58:29 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:30 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d.220fcd9f-68d3-43ed-8994-93a0cc7c46fd" returned: 0 in 0.400s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:30 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] Lock "cinder-quobyte-220fcd9f-68d3-43ed-8994-93a0cc7c46fd" released by "_delete_snapshot" :: held 2.043s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:58:30 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] Lock "cinder-quobyte-d03bed8b-ce11-4526-9f00-7ea78dcc799d" released by "delete_snapshot" :: held 2.085s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:58:30 devstack cinder-volume[86977]: WARNING cinder.quota [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 14 12:58:30 devstack cinder-volume[86977]: DEBUG cinder.quota [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] Created reservations ['bc05540e-a3c5-4cdf-a7d1-abf638be55e6', 'd923c2f9-fabe-4203-bb10-5e97fe6df4a7', 'afdb9750-d09b-4044-99e8-e26c575def60', 'f8b056f0-1a4e-47fd-a903-d4ddd1917823'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 12:58:30 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] Delete snapshot completed successfully. Jul 14 12:58:30 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-8b03084f-c5b4-4ff3-8fcf-7d37d13c6d23 req-7c371e61-9723-470f-8bb7-e769673c6e85 tempest-VolumesSnapshotsTestJSON-819802978 None] Lock "cinder-220fcd9f-68d3-43ed-8994-93a0cc7c46fd-delete_snapshot" released by "delete_snapshot" :: held 2.314s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:58:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-b948f6bb-e539-49dd-9cbc-95065b5ac0e8 req-12688814-7ffe-4985-b945-30823923a345 tempest-VolumesSnapshotsTestJSON-819802978 None] Acquiring lock "cinder-d03bed8b-ce11-4526-9f00-7ea78dcc799d-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:58:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-b948f6bb-e539-49dd-9cbc-95065b5ac0e8 req-12688814-7ffe-4985-b945-30823923a345 tempest-VolumesSnapshotsTestJSON-819802978 None] Lock "cinder-d03bed8b-ce11-4526-9f00-7ea78dcc799d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:58:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-b948f6bb-e539-49dd-9cbc-95065b5ac0e8 req-12688814-7ffe-4985-b945-30823923a345 tempest-VolumesSnapshotsTestJSON-819802978 None] Acquiring lock "cinder-quobyte-d03bed8b-ce11-4526-9f00-7ea78dcc799d" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:58:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-b948f6bb-e539-49dd-9cbc-95065b5ac0e8 req-12688814-7ffe-4985-b945-30823923a345 tempest-VolumesSnapshotsTestJSON-819802978 None] Lock "cinder-quobyte-d03bed8b-ce11-4526-9f00-7ea78dcc799d" acquired by "delete_volume" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:58:32 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b0ffc1-0672-459e-88b9-e01e4e1569cd]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:58:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-b948f6bb-e539-49dd-9cbc-95065b5ac0e8 req-12688814-7ffe-4985-b945-30823923a345 tempest-VolumesSnapshotsTestJSON-819802978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:32 devstack sudo[91267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d Jul 14 12:58:32 devstack sudo[91267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:33 devstack sudo[91267]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-b948f6bb-e539-49dd-9cbc-95065b5ac0e8 req-12688814-7ffe-4985-b945-30823923a345 tempest-VolumesSnapshotsTestJSON-819802978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d" returned: 0 in 0.462s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-b948f6bb-e539-49dd-9cbc-95065b5ac0e8 req-12688814-7ffe-4985-b945-30823923a345 tempest-VolumesSnapshotsTestJSON-819802978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:33 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d Jul 14 12:58:33 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:33 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-b948f6bb-e539-49dd-9cbc-95065b5ac0e8 req-12688814-7ffe-4985-b945-30823923a345 tempest-VolumesSnapshotsTestJSON-819802978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d03bed8b-ce11-4526-9f00-7ea78dcc799d" returned: 0 in 0.266s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-b948f6bb-e539-49dd-9cbc-95065b5ac0e8 req-12688814-7ffe-4985-b945-30823923a345 tempest-VolumesSnapshotsTestJSON-819802978 None] Lock "cinder-quobyte-d03bed8b-ce11-4526-9f00-7ea78dcc799d" released by "delete_volume" :: held 0.816s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:58:33 devstack cinder-volume[86977]: DEBUG cinder.quota [req-b948f6bb-e539-49dd-9cbc-95065b5ac0e8 req-12688814-7ffe-4985-b945-30823923a345 tempest-VolumesSnapshotsTestJSON-819802978 None] Created reservations ['0dc2bafd-69b4-4038-8756-3cc00433aa27', 'c7e026dd-c7dd-47a5-851f-5d49cece9ba7', 'ca87540b-21a3-4a77-94c8-24333257a188', '747f975a-ae03-463d-abb1-0e50b12ea2d5'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 12:58:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-b948f6bb-e539-49dd-9cbc-95065b5ac0e8 req-12688814-7ffe-4985-b945-30823923a345 tempest-VolumesSnapshotsTestJSON-819802978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:58:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-b948f6bb-e539-49dd-9cbc-95065b5ac0e8 req-12688814-7ffe-4985-b945-30823923a345 tempest-VolumesSnapshotsTestJSON-819802978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:58:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [req-b948f6bb-e539-49dd-9cbc-95065b5ac0e8 req-12688814-7ffe-4985-b945-30823923a345 tempest-VolumesSnapshotsTestJSON-819802978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:58:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [req-b948f6bb-e539-49dd-9cbc-95065b5ac0e8 req-12688814-7ffe-4985-b945-30823923a345 tempest-VolumesSnapshotsTestJSON-819802978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:58:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-b948f6bb-e539-49dd-9cbc-95065b5ac0e8 req-12688814-7ffe-4985-b945-30823923a345 tempest-VolumesSnapshotsTestJSON-819802978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:58:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-b948f6bb-e539-49dd-9cbc-95065b5ac0e8 req-12688814-7ffe-4985-b945-30823923a345 tempest-VolumesSnapshotsTestJSON-819802978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:58:33 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:58:33 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:58:33 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Jul 14 12:58:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-b948f6bb-e539-49dd-9cbc-95065b5ac0e8 req-12688814-7ffe-4985-b945-30823923a345 tempest-VolumesSnapshotsTestJSON-819802978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.294s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:58:33 devstack cinder-volume[86977]: DEBUG cinder.manager [req-b948f6bb-e539-49dd-9cbc-95065b5ac0e8 req-12688814-7ffe-4985-b945-30823923a345 tempest-VolumesSnapshotsTestJSON-819802978 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:58:33 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-b948f6bb-e539-49dd-9cbc-95065b5ac0e8 req-12688814-7ffe-4985-b945-30823923a345 tempest-VolumesSnapshotsTestJSON-819802978 None] Deleted volume successfully. Jul 14 12:58:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-b948f6bb-e539-49dd-9cbc-95065b5ac0e8 req-12688814-7ffe-4985-b945-30823923a345 tempest-VolumesSnapshotsTestJSON-819802978 None] Lock "cinder-d03bed8b-ce11-4526-9f00-7ea78dcc799d-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:58:43 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8c1a7ab9-8afa-4bfc-8cb1-50c9d0b0fe68 tempest-BackendsCapabilitiesAdminTestsJSON-1815590627 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86977) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 14 12:58:43 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-045bbb76-f551-48ec-969f-2ebf2d005256 tempest-BackendsCapabilitiesAdminTestsJSON-1815590627 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86977) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 14 12:58:43 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=52,cinder:UPDATE=63,cinder:INSERT=14,cinder:DELETE=5 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 12:58:43 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=48,cinder:UPDATE=59,cinder:INSERT=15,cinder:DELETE=5 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 12:59:01 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 12:59:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Flow 'volume_create_manager' (8e6546c0-33b3-4fa7-ba3c-deb06e994c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:59:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43eecbc-477c-4b48-8270-8d50edf82abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43eecbc-477c-4b48-8270-8d50edf82abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-675861487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557147b8-0e62-48b2-a97b-a525315c0aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39427cba4fa469daf791674e07657f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:59:01Z,use_quota=True,user_id='7b7c8f7067204e4cac7c520d77bc556d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feae458e-a18d-4eb6-b6b8-2ed353385d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feae458e-a18d-4eb6-b6b8-2ed353385d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a4d2be2-e130-45fc-8e53-63a331ee3dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a4d2be2-e130-45fc-8e53-63a331ee3dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '557147b8-0e62-48b2-a97b-a525315c0aee', 'volume_name': 'volume-557147b8-0e62-48b2-a97b-a525315c0aee', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (017dcef6-15c5-4999-b101-ec176ae6a7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (017dcef6-15c5-4999-b101-ec176ae6a7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a63b181-359c-45ff-ae88-d6fe6891cfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:01 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Volume 557147b8-0e62-48b2-a97b-a525315c0aee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-557147b8-0e62-48b2-a97b-a525315c0aee', 'volume_size': 1} Jul 14 12:59:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-675861487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557147b8-0e62-48b2-a97b-a525315c0aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39427cba4fa469daf791674e07657f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:59:01Z,use_quota=True,user_id='7b7c8f7067204e4cac7c520d77bc556d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 12:59:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Creating volume 557147b8-0e62-48b2-a97b-a525315c0aee {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 12:59:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:59:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:59:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 12:59:01 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 12:59:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-557147b8-0e62-48b2-a97b-a525315c0aee 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:01 devstack sudo[91648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-557147b8-0e62-48b2-a97b-a525315c0aee 1073741824 Jul 14 12:59:01 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:02 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-557147b8-0e62-48b2-a97b-a525315c0aee 1073741824" returned: 0 in 0.753s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-557147b8-0e62-48b2-a97b-a525315c0aee {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:02 devstack sudo[91656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-557147b8-0e62-48b2-a97b-a525315c0aee Jul 14 12:59:02 devstack sudo[91656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:02 devstack sudo[91656]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-557147b8-0e62-48b2-a97b-a525315c0aee" returned: 0 in 0.497s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 12:59:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Flow 'volume_create_manager' (5579e283-9eda-4bac-bf74-ddb1eb6c0d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b75f7ff-b688-42ce-b472-5c734f61f52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b75f7ff-b688-42ce-b472-5c734f61f52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1919084708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7681828a-bea8-4385-b636-6f1813b1451b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3d9772c83347f099522b94f8db639d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:59:03Z,use_quota=True,user_id='5e36c879f022451dbf6ef9f2d1932176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c824d140-a353-4273-ba1d-7d9466c6f92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c824d140-a353-4273-ba1d-7d9466c6f92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e98373a-c84a-41c4-9ebf-b45db8f2cf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e98373a-c84a-41c4-9ebf-b45db8f2cf0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7681828a-bea8-4385-b636-6f1813b1451b', 'volume_name': 'volume-7681828a-bea8-4385-b636-6f1813b1451b', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe43e2a5-95fd-4768-8498-a7d9d6468e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe43e2a5-95fd-4768-8498-a7d9d6468e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1905d585-01d1-42b6-b3a0-a1b988a0483c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:03 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Volume 7681828a-bea8-4385-b636-6f1813b1451b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7681828a-bea8-4385-b636-6f1813b1451b', 'volume_size': 1} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1919084708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7681828a-bea8-4385-b636-6f1813b1451b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3d9772c83347f099522b94f8db639d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:59:03Z,use_quota=True,user_id='5e36c879f022451dbf6ef9f2d1932176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Creating volume 7681828a-bea8-4385-b636-6f1813b1451b {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 12:59:03 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7681828a-bea8-4385-b636-6f1813b1451b 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:03 devstack sudo[91660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7681828a-bea8-4385-b636-6f1813b1451b 1073741824 Jul 14 12:59:03 devstack sudo[91660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a63b181-359c-45ff-ae88-d6fe6891cfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-557147b8-0e62-48b2-a97b-a525315c0aee', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6936bc63-bf23-4308-b25b-1c220c07b672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:03 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Volume volume-557147b8-0e62-48b2-a97b-a525315c0aee (557147b8-0e62-48b2-a97b-a525315c0aee): created successfully Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6936bc63-bf23-4308-b25b-1c220c07b672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Flow 'volume_create_manager' (8e6546c0-33b3-4fa7-ba3c-deb06e994c18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:59:03 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-ee3d3cba-2152-42d3-8ecb-9c9fd73ca369 tempest-ServerRescueNegativeTestJSON-239907132 None] Created volume successfully. Jul 14 12:59:03 devstack sudo[91660]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7681828a-bea8-4385-b636-6f1813b1451b 1073741824" returned: 0 in 0.744s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7681828a-bea8-4385-b636-6f1813b1451b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:04 devstack sudo[91666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7681828a-bea8-4385-b636-6f1813b1451b Jul 14 12:59:04 devstack sudo[91666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:04 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-df0fe93c-b5e5-4abd-80ff-43cfde090e6f tempest-GroupsTest-959755239 None] Group tempest-Group1-2092974823: creating Jul 14 12:59:04 devstack sudo[91666]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7681828a-bea8-4385-b636-6f1813b1451b" returned: 0 in 0.434s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 12:59:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1905d585-01d1-42b6-b3a0-a1b988a0483c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7681828a-bea8-4385-b636-6f1813b1451b', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c42056a-f922-47d3-b1b7-4ed080fc550b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:04 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-df0fe93c-b5e5-4abd-80ff-43cfde090e6f tempest-GroupsTest-959755239 None] Group tempest-Group1-2092974823: created successfully Jul 14 12:59:04 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Volume volume-7681828a-bea8-4385-b636-6f1813b1451b (7681828a-bea8-4385-b636-6f1813b1451b): created successfully Jul 14 12:59:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c42056a-f922-47d3-b1b7-4ed080fc550b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Flow 'volume_create_manager' (5579e283-9eda-4bac-bf74-ddb1eb6c0d3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:59:04 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-df0fe93c-b5e5-4abd-80ff-43cfde090e6f tempest-GroupsTest-959755239 None] Create group completed successfully. Jul 14 12:59:04 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-21a9e98a-b9eb-4582-ad2d-2d171e33cc6e tempest-AttachVolumeTestJSON-899158441 None] Created volume successfully. Jul 14 12:59:05 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b0d3b029-8475-40d3-8e03-c58d221bf8d0 tempest-GroupsTest-959755239 None] Group tempest-Group2-871164737: creating Jul 14 12:59:06 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b0d3b029-8475-40d3-8e03-c58d221bf8d0 tempest-GroupsTest-959755239 None] Group tempest-Group2-871164737: created successfully Jul 14 12:59:06 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b0d3b029-8475-40d3-8e03-c58d221bf8d0 tempest-GroupsTest-959755239 None] Create group completed successfully. Jul 14 12:59:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-c0a5b88a-a6c4-4792-b0b2-a2c5a9124113 req-137f0487-b5ac-42ea-9e8e-1ed91e525680 tempest-AttachVolumeTestJSON-899158441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-c0a5b88a-a6c4-4792-b0b2-a2c5a9124113 req-137f0487-b5ac-42ea-9e8e-1ed91e525680 tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:06 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5a495f-c04f-4ef4-a50d-fd2d95342c39]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:59:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-c0a5b88a-a6c4-4792-b0b2-a2c5a9124113 req-137f0487-b5ac-42ea-9e8e-1ed91e525680 tempest-AttachVolumeTestJSON-899158441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7681828a-bea8-4385-b636-6f1813b1451b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:07 devstack sudo[91692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7681828a-bea8-4385-b636-6f1813b1451b Jul 14 12:59:07 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:07 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-c0a5b88a-a6c4-4792-b0b2-a2c5a9124113 req-137f0487-b5ac-42ea-9e8e-1ed91e525680 tempest-AttachVolumeTestJSON-899158441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7681828a-bea8-4385-b636-6f1813b1451b" returned: 0 in 0.759s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-c0a5b88a-a6c4-4792-b0b2-a2c5a9124113 req-137f0487-b5ac-42ea-9e8e-1ed91e525680 tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.816s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:07 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-c0a5b88a-a6c4-4792-b0b2-a2c5a9124113 req-137f0487-b5ac-42ea-9e8e-1ed91e525680 tempest-AttachVolumeTestJSON-899158441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1', 'name': 'volume-7681828a-bea8-4385-b636-6f1813b1451b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e2be5bd-77fb-4fd3-8b2e-274aa222da81', 'enforce_multipath': True} {{(pid=86977) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 12:59:07 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-c0a5b88a-a6c4-4792-b0b2-a2c5a9124113 req-137f0487-b5ac-42ea-9e8e-1ed91e525680 tempest-AttachVolumeTestJSON-899158441 None] attachment_update completed successfully. Jul 14 12:59:08 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 12:59:08 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Flow 'volume_create_manager' (437d0f92-d651-444b-8f97-a04097fc6062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:59:08 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4908f2e3-7062-4490-b3fa-d2f6d2dee025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:08 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4908f2e3-7062-4490-b3fa-d2f6d2dee025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-556087046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=680e829f-9623-465c-86af-6feed4263ec2,host='devstack@QuobyteHD#QuobyteHD',id=3cb88f57-8e51-4fcd-8eed-3a28759fb768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514673e4c57e4712a62d46ac5fa49cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:59:08Z,use_quota=True,user_id='6aff13cf44c64094914c4308539e8d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19aa5640-e4b1-4dfa-980a-4a7cfcf5b32f),volume_type_id=19aa5640-e4b1-4dfa-980a-4a7cfcf5b32f)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:08 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e96d908-c113-4adc-a489-13b33231a352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:08 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e96d908-c113-4adc-a489-13b33231a352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:08 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d22ec13-9ead-494b-a755-13fd03d9f044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:08 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d22ec13-9ead-494b-a755-13fd03d9f044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cb88f57-8e51-4fcd-8eed-3a28759fb768', 'volume_name': 'volume-3cb88f57-8e51-4fcd-8eed-3a28759fb768', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:08 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b888e966-5c3a-4772-8dfb-7f3d2509619e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:08 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b888e966-5c3a-4772-8dfb-7f3d2509619e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:08 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e42ac4d0-c6fd-4252-b3a4-a3a28bd57eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:08 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Volume 3cb88f57-8e51-4fcd-8eed-3a28759fb768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cb88f57-8e51-4fcd-8eed-3a28759fb768', 'volume_size': 1} Jul 14 12:59:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:08 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=680e829f-9623-465c-86af-6feed4263ec2,created_at=2026-07-14T10:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-556087046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=680e829f-9623-465c-86af-6feed4263ec2,host='devstack@QuobyteHD#QuobyteHD',id=3cb88f57-8e51-4fcd-8eed-3a28759fb768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514673e4c57e4712a62d46ac5fa49cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:59:08Z,use_quota=True,user_id='6aff13cf44c64094914c4308539e8d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19aa5640-e4b1-4dfa-980a-4a7cfcf5b32f),volume_type_id=19aa5640-e4b1-4dfa-980a-4a7cfcf5b32f)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 12:59:08 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Creating volume 3cb88f57-8e51-4fcd-8eed-3a28759fb768 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 12:59:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:08 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:59:08 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:59:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:08 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 12:59:08 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 12:59:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3cb88f57-8e51-4fcd-8eed-3a28759fb768 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:08 devstack sudo[91771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3cb88f57-8e51-4fcd-8eed-3a28759fb768 1073741824 Jul 14 12:59:08 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:09 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3cb88f57-8e51-4fcd-8eed-3a28759fb768 1073741824" returned: 0 in 1.124s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3cb88f57-8e51-4fcd-8eed-3a28759fb768 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:09 devstack sudo[92114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3cb88f57-8e51-4fcd-8eed-3a28759fb768 Jul 14 12:59:09 devstack sudo[92114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:10 devstack sudo[92114]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3cb88f57-8e51-4fcd-8eed-3a28759fb768" returned: 0 in 0.669s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 12:59:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.923s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e42ac4d0-c6fd-4252-b3a4-a3a28bd57eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cb88f57-8e51-4fcd-8eed-3a28759fb768', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83609d1-159a-4817-bde7-45169bf0a6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:10 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Volume volume-3cb88f57-8e51-4fcd-8eed-3a28759fb768 (3cb88f57-8e51-4fcd-8eed-3a28759fb768): created successfully Jul 14 12:59:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83609d1-159a-4817-bde7-45169bf0a6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Flow 'volume_create_manager' (437d0f92-d651-444b-8f97-a04097fc6062) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:59:10 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c33ef64c-cada-487f-81f6-c246dc32c40a tempest-GroupsTest-959755239 None] Created volume successfully. Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Flow 'volume_create_manager' (9744361d-ec47-4952-a820-376a9364fd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3fdd371-1fc7-4634-b299-ad91c3fcd313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3fdd371-1fc7-4634-b299-ad91c3fcd313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-135739185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8dfde4-46ec-4f6c-b24e-a458b8985c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3d9772c83347f099522b94f8db639d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:59:12Z,use_quota=True,user_id='5e36c879f022451dbf6ef9f2d1932176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d649d2-07cb-48d7-86d1-187e7e2699fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d649d2-07cb-48d7-86d1-187e7e2699fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d3b3ad-0667-4cdb-b072-2c19a9561eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d3b3ad-0667-4cdb-b072-2c19a9561eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c8dfde4-46ec-4f6c-b24e-a458b8985c14', 'volume_name': 'volume-7c8dfde4-46ec-4f6c-b24e-a458b8985c14', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (142cfe39-88ac-4170-be3b-2f3599d6ca33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (142cfe39-88ac-4170-be3b-2f3599d6ca33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25eca081-9544-401d-bfa9-cf7c388d8825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:12 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Volume 7c8dfde4-46ec-4f6c-b24e-a458b8985c14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c8dfde4-46ec-4f6c-b24e-a458b8985c14', 'volume_size': 1} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-135739185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8dfde4-46ec-4f6c-b24e-a458b8985c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3d9772c83347f099522b94f8db639d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:59:12Z,use_quota=True,user_id='5e36c879f022451dbf6ef9f2d1932176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Creating volume 7c8dfde4-46ec-4f6c-b24e-a458b8985c14 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 12:59:12 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7c8dfde4-46ec-4f6c-b24e-a458b8985c14 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:12 devstack sudo[92131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7c8dfde4-46ec-4f6c-b24e-a458b8985c14 1073741824 Jul 14 12:59:12 devstack sudo[92131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-aff062fa-62b8-44c8-b692-31178e473316 tempest-GroupsTest-959755239 None] Acquiring lock "cinder-quobyte-3cb88f57-8e51-4fcd-8eed-3a28759fb768" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-aff062fa-62b8-44c8-b692-31178e473316 tempest-GroupsTest-959755239 None] Lock "cinder-quobyte-3cb88f57-8e51-4fcd-8eed-3a28759fb768" acquired by "delete_volume" :: waited 0.071s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[be00c908-5c03-4db7-be19-b7e79a1e3a6d]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:59:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aff062fa-62b8-44c8-b692-31178e473316 tempest-GroupsTest-959755239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3cb88f57-8e51-4fcd-8eed-3a28759fb768 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:12 devstack sudo[92134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3cb88f57-8e51-4fcd-8eed-3a28759fb768 Jul 14 12:59:12 devstack sudo[92134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:13 devstack sudo[92131]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7c8dfde4-46ec-4f6c-b24e-a458b8985c14 1073741824" returned: 0 in 0.987s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7c8dfde4-46ec-4f6c-b24e-a458b8985c14 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:13 devstack sudo[92134]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aff062fa-62b8-44c8-b692-31178e473316 tempest-GroupsTest-959755239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3cb88f57-8e51-4fcd-8eed-3a28759fb768" returned: 0 in 0.830s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aff062fa-62b8-44c8-b692-31178e473316 tempest-GroupsTest-959755239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3cb88f57-8e51-4fcd-8eed-3a28759fb768 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:13 devstack sudo[92149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7c8dfde4-46ec-4f6c-b24e-a458b8985c14 Jul 14 12:59:13 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:13 devstack sudo[92150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3cb88f57-8e51-4fcd-8eed-3a28759fb768 Jul 14 12:59:13 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:13 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7c8dfde4-46ec-4f6c-b24e-a458b8985c14" returned: 0 in 0.597s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 12:59:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:14 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25eca081-9544-401d-bfa9-cf7c388d8825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c8dfde4-46ec-4f6c-b24e-a458b8985c14', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e374e4b-eede-4cde-bf27-4f4ba134c8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aff062fa-62b8-44c8-b692-31178e473316 tempest-GroupsTest-959755239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3cb88f57-8e51-4fcd-8eed-3a28759fb768" returned: 0 in 0.625s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-aff062fa-62b8-44c8-b692-31178e473316 tempest-GroupsTest-959755239 None] Lock "cinder-quobyte-3cb88f57-8e51-4fcd-8eed-3a28759fb768" released by "delete_volume" :: held 1.571s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:59:14 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Volume volume-7c8dfde4-46ec-4f6c-b24e-a458b8985c14 (7c8dfde4-46ec-4f6c-b24e-a458b8985c14): created successfully Jul 14 12:59:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e374e4b-eede-4cde-bf27-4f4ba134c8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Flow 'volume_create_manager' (9744361d-ec47-4952-a820-376a9364fd5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:59:14 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-4c8a4ff2-8ebd-4a06-bb41-7a5393a26752 tempest-AttachVolumeTestJSON-899158441 None] Created volume successfully. Jul 14 12:59:14 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-aff062fa-62b8-44c8-b692-31178e473316 tempest-GroupsTest-959755239 None] Created reservations ['80294434-aee8-4aa9-b9d1-1e64185b0b31'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 12:59:14 devstack cinder-volume[86977]: WARNING cinder.quota [None req-aff062fa-62b8-44c8-b692-31178e473316 tempest-GroupsTest-959755239 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-764025642 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-764025642, it is now deprecated. Please use the default quota class for default quota. Jul 14 12:59:14 devstack cinder-volume[86977]: WARNING cinder.quota [None req-aff062fa-62b8-44c8-b692-31178e473316 tempest-GroupsTest-959755239 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-764025642 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-764025642, it is now deprecated. Please use the default quota class for default quota. Jul 14 12:59:14 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-aff062fa-62b8-44c8-b692-31178e473316 tempest-GroupsTest-959755239 None] Created reservations ['bf5ea195-aad4-40de-bbc9-0daf5245d8d4', '8dfa0827-224f-44c3-903e-d2a827774ec6', 'f6409aee-5865-4196-a3bb-b82e28209714', 'b4e7338a-18e7-4d49-96cb-37470900d210'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 12:59:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aff062fa-62b8-44c8-b692-31178e473316 tempest-GroupsTest-959755239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aff062fa-62b8-44c8-b692-31178e473316 tempest-GroupsTest-959755239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-aff062fa-62b8-44c8-b692-31178e473316 tempest-GroupsTest-959755239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:59:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-aff062fa-62b8-44c8-b692-31178e473316 tempest-GroupsTest-959755239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:59:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aff062fa-62b8-44c8-b692-31178e473316 tempest-GroupsTest-959755239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aff062fa-62b8-44c8-b692-31178e473316 tempest-GroupsTest-959755239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:14 devstack sudo[92176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:59:14 devstack sudo[92176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:14 devstack sudo[92176]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aff062fa-62b8-44c8-b692-31178e473316 tempest-GroupsTest-959755239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.388s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:14 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-aff062fa-62b8-44c8-b692-31178e473316 tempest-GroupsTest-959755239 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:59:14 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-aff062fa-62b8-44c8-b692-31178e473316 tempest-GroupsTest-959755239 None] Delete group completed successfully. Jul 14 12:59:15 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-8a0d9813-cc77-41fd-a7fd-e8f341416c0b tempest-GroupsTest-959755239 None] Created reservations ['e5f98e78-d6c6-4d66-a080-4cdd9211ce89'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 12:59:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8a0d9813-cc77-41fd-a7fd-e8f341416c0b tempest-GroupsTest-959755239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8a0d9813-cc77-41fd-a7fd-e8f341416c0b tempest-GroupsTest-959755239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8a0d9813-cc77-41fd-a7fd-e8f341416c0b tempest-GroupsTest-959755239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:59:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8a0d9813-cc77-41fd-a7fd-e8f341416c0b tempest-GroupsTest-959755239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:59:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8a0d9813-cc77-41fd-a7fd-e8f341416c0b tempest-GroupsTest-959755239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8a0d9813-cc77-41fd-a7fd-e8f341416c0b tempest-GroupsTest-959755239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:15 devstack sudo[92223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:59:15 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:16 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8a0d9813-cc77-41fd-a7fd-e8f341416c0b tempest-GroupsTest-959755239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.434s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8a0d9813-cc77-41fd-a7fd-e8f341416c0b tempest-GroupsTest-959755239 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:59:16 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-8a0d9813-cc77-41fd-a7fd-e8f341416c0b tempest-GroupsTest-959755239 None] Delete group completed successfully. Jul 14 12:59:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 12:59:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:59:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:59:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:16 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:59:16 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-e277f152-3ccc-41cb-b53b-02ea1c7533f3 req-f5a8a43b-5ab5-41f5-a8f2-2a472170afd1 tempest-AttachVolumeTestJSON-899158441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-e277f152-3ccc-41cb-b53b-02ea1c7533f3 req-f5a8a43b-5ab5-41f5-a8f2-2a472170afd1 tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:16 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c43229-614f-42f7-8497-79651c86e354]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:59:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-e277f152-3ccc-41cb-b53b-02ea1c7533f3 req-f5a8a43b-5ab5-41f5-a8f2-2a472170afd1 tempest-AttachVolumeTestJSON-899158441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7c8dfde4-46ec-4f6c-b24e-a458b8985c14 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:16 devstack sudo[92238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7c8dfde4-46ec-4f6c-b24e-a458b8985c14 Jul 14 12:59:16 devstack sudo[92238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:16 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.305s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:59:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 12:59:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 8 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 12:59:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 12:59:17 devstack sudo[92238]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-e277f152-3ccc-41cb-b53b-02ea1c7533f3 req-f5a8a43b-5ab5-41f5-a8f2-2a472170afd1 tempest-AttachVolumeTestJSON-899158441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7c8dfde4-46ec-4f6c-b24e-a458b8985c14" returned: 0 in 0.551s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-e277f152-3ccc-41cb-b53b-02ea1c7533f3 req-f5a8a43b-5ab5-41f5-a8f2-2a472170afd1 tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.580s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-e277f152-3ccc-41cb-b53b-02ea1c7533f3 req-f5a8a43b-5ab5-41f5-a8f2-2a472170afd1 tempest-AttachVolumeTestJSON-899158441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1', 'name': 'volume-7c8dfde4-46ec-4f6c-b24e-a458b8985c14', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd304aa53-5a6d-4905-a74a-209d01e9c789', 'enforce_multipath': True} {{(pid=86977) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 12:59:17 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-e277f152-3ccc-41cb-b53b-02ea1c7533f3 req-f5a8a43b-5ab5-41f5-a8f2-2a472170afd1 tempest-AttachVolumeTestJSON-899158441 None] attachment_update completed successfully. Jul 14 12:59:17 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-29f12f7d-9e9d-44a0-9786-7bf82065b8ab tempest-GroupsTest-959755239 None] Group tempest-GroupsTest-Group-946766798: creating Jul 14 12:59:17 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-29f12f7d-9e9d-44a0-9786-7bf82065b8ab tempest-GroupsTest-959755239 None] Group tempest-GroupsTest-Group-946766798: created successfully Jul 14 12:59:17 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-29f12f7d-9e9d-44a0-9786-7bf82065b8ab tempest-GroupsTest-959755239 None] Create group completed successfully. Jul 14 12:59:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d350680d-3fdd-4be8-b43f-0da4829ed9f9 tempest-ServerRescueNegativeTestJSON-239907132 None] Acquiring lock "cinder-557147b8-0e62-48b2-a97b-a525315c0aee-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:59:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d350680d-3fdd-4be8-b43f-0da4829ed9f9 tempest-ServerRescueNegativeTestJSON-239907132 None] Lock "cinder-557147b8-0e62-48b2-a97b-a525315c0aee-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:59:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d350680d-3fdd-4be8-b43f-0da4829ed9f9 tempest-ServerRescueNegativeTestJSON-239907132 None] Acquiring lock "cinder-quobyte-557147b8-0e62-48b2-a97b-a525315c0aee" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:59:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d350680d-3fdd-4be8-b43f-0da4829ed9f9 tempest-ServerRescueNegativeTestJSON-239907132 None] Lock "cinder-quobyte-557147b8-0e62-48b2-a97b-a525315c0aee" acquired by "delete_volume" :: waited 0.037s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:59:18 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28a6e15-18ee-409a-93b8-0218a14966d3]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:59:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d350680d-3fdd-4be8-b43f-0da4829ed9f9 tempest-ServerRescueNegativeTestJSON-239907132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-557147b8-0e62-48b2-a97b-a525315c0aee {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:18 devstack sudo[92254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-557147b8-0e62-48b2-a97b-a525315c0aee Jul 14 12:59:18 devstack sudo[92254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:19 devstack sudo[92254]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d350680d-3fdd-4be8-b43f-0da4829ed9f9 tempest-ServerRescueNegativeTestJSON-239907132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-557147b8-0e62-48b2-a97b-a525315c0aee" returned: 0 in 0.709s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d350680d-3fdd-4be8-b43f-0da4829ed9f9 tempest-ServerRescueNegativeTestJSON-239907132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-557147b8-0e62-48b2-a97b-a525315c0aee {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:19 devstack sudo[92259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-557147b8-0e62-48b2-a97b-a525315c0aee Jul 14 12:59:19 devstack sudo[92259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Flow 'volume_create_manager' (0895daff-7564-438a-845b-b1ff219b51dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52add8bd-6858-40fe-979e-fd6a7c5ba0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52add8bd-6858-40fe-979e-fd6a7c5ba0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1686626408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3b0b8c9-47d2-4f05-b1a2-0bed40674240,host='devstack@QuobyteHD#QuobyteHD',id=1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514673e4c57e4712a62d46ac5fa49cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:59:19Z,use_quota=True,user_id='6aff13cf44c64094914c4308539e8d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(290b7a62-40a2-42ed-a707-a0574d8eeb9d),volume_type_id=290b7a62-40a2-42ed-a707-a0574d8eeb9d)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b28130-7455-4cc6-ae2a-620706cd685d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b28130-7455-4cc6-ae2a-620706cd685d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e4375a-484e-4111-92f9-b89fa9de99d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e4375a-484e-4111-92f9-b89fa9de99d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc', 'volume_name': 'volume-1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17e28f5-fe9d-4ab8-bc71-5619ac28f2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17e28f5-fe9d-4ab8-bc71-5619ac28f2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814f6d42-52df-45f0-854c-41b313e7d042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:19 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Volume 1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc', 'volume_size': 1} Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d3b0b8c9-47d2-4f05-b1a2-0bed40674240,created_at=2026-07-14T10:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1686626408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3b0b8c9-47d2-4f05-b1a2-0bed40674240,host='devstack@QuobyteHD#QuobyteHD',id=1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514673e4c57e4712a62d46ac5fa49cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:59:19Z,use_quota=True,user_id='6aff13cf44c64094914c4308539e8d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(290b7a62-40a2-42ed-a707-a0574d8eeb9d),volume_type_id=290b7a62-40a2-42ed-a707-a0574d8eeb9d)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Creating volume 1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:59:19 devstack sudo[92259]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 12:59:19 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d350680d-3fdd-4be8-b43f-0da4829ed9f9 tempest-ServerRescueNegativeTestJSON-239907132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-557147b8-0e62-48b2-a97b-a525315c0aee" returned: 0 in 0.668s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:19 devstack sudo[92264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc 1073741824 Jul 14 12:59:19 devstack sudo[92264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d350680d-3fdd-4be8-b43f-0da4829ed9f9 tempest-ServerRescueNegativeTestJSON-239907132 None] Lock "cinder-quobyte-557147b8-0e62-48b2-a97b-a525315c0aee" released by "delete_volume" :: held 1.503s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:59:19 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-d350680d-3fdd-4be8-b43f-0da4829ed9f9 tempest-ServerRescueNegativeTestJSON-239907132 None] Created reservations ['a1391a67-974a-441f-906d-73ca67d11531', 'da068cbe-e17c-4c9c-9267-ac81fdfb5fff', 'f19476e8-826f-4d34-aab8-6c50fdeeeead', 'c698abaf-4433-4115-8e66-9310f4597fa7'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 12:59:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d350680d-3fdd-4be8-b43f-0da4829ed9f9 tempest-ServerRescueNegativeTestJSON-239907132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d350680d-3fdd-4be8-b43f-0da4829ed9f9 tempest-ServerRescueNegativeTestJSON-239907132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d350680d-3fdd-4be8-b43f-0da4829ed9f9 tempest-ServerRescueNegativeTestJSON-239907132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:59:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d350680d-3fdd-4be8-b43f-0da4829ed9f9 tempest-ServerRescueNegativeTestJSON-239907132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:59:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d350680d-3fdd-4be8-b43f-0da4829ed9f9 tempest-ServerRescueNegativeTestJSON-239907132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d350680d-3fdd-4be8-b43f-0da4829ed9f9 tempest-ServerRescueNegativeTestJSON-239907132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:20 devstack sudo[92266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:59:20 devstack sudo[92266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:20 devstack sudo[92264]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc 1073741824" returned: 0 in 0.863s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:20 devstack sudo[92266]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d350680d-3fdd-4be8-b43f-0da4829ed9f9 tempest-ServerRescueNegativeTestJSON-239907132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.548s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:20 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-d350680d-3fdd-4be8-b43f-0da4829ed9f9 tempest-ServerRescueNegativeTestJSON-239907132 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:59:20 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-d350680d-3fdd-4be8-b43f-0da4829ed9f9 tempest-ServerRescueNegativeTestJSON-239907132 None] Deleted volume successfully. Jul 14 12:59:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d350680d-3fdd-4be8-b43f-0da4829ed9f9 tempest-ServerRescueNegativeTestJSON-239907132 None] Lock "cinder-557147b8-0e62-48b2-a97b-a525315c0aee-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:59:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:20 devstack sudo[92274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc Jul 14 12:59:20 devstack sudo[92274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:21 devstack sudo[92274]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc" returned: 0 in 0.436s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 12:59:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814f6d42-52df-45f0-854c-41b313e7d042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c7f8b82-37ff-4df1-b585-6b77e6f1b160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:21 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Volume volume-1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc (1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc): created successfully Jul 14 12:59:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c7f8b82-37ff-4df1-b585-6b77e6f1b160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Flow 'volume_create_manager' (0895daff-7564-438a-845b-b1ff219b51dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:59:21 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-290e5bb9-a065-453f-b1a3-f108bac4804c tempest-GroupsTest-959755239 None] Created volume successfully. Jul 14 12:59:21 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-0bad4a5a-68db-4a36-8be7-fb6ef2262494 req-fc80a22f-9b47-44f6-822d-48b858a385fa tempest-AttachVolumeTestJSON-899158441 None] Terminate volume connection completed successfully. Jul 14 12:59:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-0bad4a5a-68db-4a36-8be7-fb6ef2262494 req-fc80a22f-9b47-44f6-822d-48b858a385fa tempest-AttachVolumeTestJSON-899158441 None] Deleting attachment 4e2be5bd-77fb-4fd3-8b2e-274aa222da81. {{(pid=86977) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 12:59:23 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 12:59:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Flow 'volume_create_manager' (b47f186f-458e-43c1-b8f4-5b042ff65797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:59:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1373a74-4421-4bf9-a319-bfd5eb4c4b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1373a74-4421-4bf9-a319-bfd5eb4c4b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1146479750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3b0b8c9-47d2-4f05-b1a2-0bed40674240,host='devstack@QuobyteHD#QuobyteHD',id=744af1eb-590c-4723-9097-7e725e8cc64c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514673e4c57e4712a62d46ac5fa49cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:59:24Z,use_quota=True,user_id='6aff13cf44c64094914c4308539e8d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(290b7a62-40a2-42ed-a707-a0574d8eeb9d),volume_type_id=290b7a62-40a2-42ed-a707-a0574d8eeb9d)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (086179db-b9f3-4096-a0ab-86bc77257bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (086179db-b9f3-4096-a0ab-86bc77257bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e46e255-fdb8-4337-b75a-f73c91800681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e46e255-fdb8-4337-b75a-f73c91800681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '744af1eb-590c-4723-9097-7e725e8cc64c', 'volume_name': 'volume-744af1eb-590c-4723-9097-7e725e8cc64c', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f725fe9c-be43-488b-b7d5-0294e306c311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f725fe9c-be43-488b-b7d5-0294e306c311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a678670c-d071-4e38-8355-10e0580b4bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:23 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Volume 744af1eb-590c-4723-9097-7e725e8cc64c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-744af1eb-590c-4723-9097-7e725e8cc64c', 'volume_size': 1} Jul 14 12:59:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d3b0b8c9-47d2-4f05-b1a2-0bed40674240,created_at=2026-07-14T10:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1146479750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3b0b8c9-47d2-4f05-b1a2-0bed40674240,host='devstack@QuobyteHD#QuobyteHD',id=744af1eb-590c-4723-9097-7e725e8cc64c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514673e4c57e4712a62d46ac5fa49cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:59:24Z,use_quota=True,user_id='6aff13cf44c64094914c4308539e8d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(290b7a62-40a2-42ed-a707-a0574d8eeb9d),volume_type_id=290b7a62-40a2-42ed-a707-a0574d8eeb9d)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 12:59:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Creating volume 744af1eb-590c-4723-9097-7e725e8cc64c {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 12:59:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:59:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:59:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 12:59:24 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 12:59:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-744af1eb-590c-4723-9097-7e725e8cc64c 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:24 devstack sudo[92344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-744af1eb-590c-4723-9097-7e725e8cc64c 1073741824 Jul 14 12:59:24 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:24 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-51873c3f-7479-43ff-8da7-25d0c342b945 req-712413f1-22db-46f7-92fd-45f4f58ee953 tempest-AttachVolumeTestJSON-899158441 None] Terminate volume connection completed successfully. Jul 14 12:59:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-51873c3f-7479-43ff-8da7-25d0c342b945 req-712413f1-22db-46f7-92fd-45f4f58ee953 tempest-AttachVolumeTestJSON-899158441 None] Deleting attachment d304aa53-5a6d-4905-a74a-209d01e9c789. {{(pid=86977) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 12:59:24 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-744af1eb-590c-4723-9097-7e725e8cc64c 1073741824" returned: 0 in 0.736s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-744af1eb-590c-4723-9097-7e725e8cc64c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:25 devstack sudo[92352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-744af1eb-590c-4723-9097-7e725e8cc64c Jul 14 12:59:25 devstack sudo[92352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:25 devstack sudo[92352]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-744af1eb-590c-4723-9097-7e725e8cc64c" returned: 0 in 0.673s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 12:59:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a678670c-d071-4e38-8355-10e0580b4bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-744af1eb-590c-4723-9097-7e725e8cc64c', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f71cee-1f4d-4001-8692-a46f6e7cf986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:25 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Volume volume-744af1eb-590c-4723-9097-7e725e8cc64c (744af1eb-590c-4723-9097-7e725e8cc64c): created successfully Jul 14 12:59:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f71cee-1f4d-4001-8692-a46f6e7cf986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Flow 'volume_create_manager' (b47f186f-458e-43c1-b8f4-5b042ff65797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:59:25 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-5eae1929-df66-400a-b709-21925f4d7b57 tempest-GroupsTest-959755239 None] Created volume successfully. Jul 14 12:59:27 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-04e2f759-6931-4f90-a3e6-fda4473af9e6 tempest-GroupsTest-959755239 None] Update group completed successfully. Jul 14 12:59:28 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-32ae3b75-f84d-4107-8e67-44ac9800e73c tempest-GroupsTest-959755239 None] Update group completed successfully. Jul 14 12:59:30 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Acquiring lock "cinder-quobyte-1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:59:30 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Lock "cinder-quobyte-1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc" acquired by "delete_volume" :: waited 0.034s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:59:30 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f53a05-ea3f-4f23-9eac-1ed40ec13db8]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:59:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:30 devstack sudo[92478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc Jul 14 12:59:30 devstack sudo[92478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:31 devstack sudo[92478]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc" returned: 0 in 0.768s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:31 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc Jul 14 12:59:31 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:31 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc" returned: 0 in 0.432s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Lock "cinder-quobyte-1b61f7a5-d2b5-4b67-b02b-a10cb23d5ebc" released by "delete_volume" :: held 1.282s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:59:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Acquiring lock "cinder-quobyte-744af1eb-590c-4723-9097-7e725e8cc64c" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:59:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Lock "cinder-quobyte-744af1eb-590c-4723-9097-7e725e8cc64c" acquired by "delete_volume" :: waited 0.026s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:59:31 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcaad2c-47ae-485d-ab11-41ddf531a87d]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:59:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-744af1eb-590c-4723-9097-7e725e8cc64c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-721512f7-e8a9-4f2a-8073-a0b19d028809 tempest-AttachVolumeTestJSON-899158441 None] Acquiring lock "cinder-7c8dfde4-46ec-4f6c-b24e-a458b8985c14-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:59:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-721512f7-e8a9-4f2a-8073-a0b19d028809 tempest-AttachVolumeTestJSON-899158441 None] Lock "cinder-7c8dfde4-46ec-4f6c-b24e-a458b8985c14-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:59:32 devstack sudo[92503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-744af1eb-590c-4723-9097-7e725e8cc64c Jul 14 12:59:32 devstack sudo[92503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-721512f7-e8a9-4f2a-8073-a0b19d028809 tempest-AttachVolumeTestJSON-899158441 None] Acquiring lock "cinder-quobyte-7c8dfde4-46ec-4f6c-b24e-a458b8985c14" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:59:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-721512f7-e8a9-4f2a-8073-a0b19d028809 tempest-AttachVolumeTestJSON-899158441 None] Lock "cinder-quobyte-7c8dfde4-46ec-4f6c-b24e-a458b8985c14" acquired by "delete_volume" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:59:32 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffa5879-dfc1-440a-8d24-b6c502e7ad30]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:59:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-721512f7-e8a9-4f2a-8073-a0b19d028809 tempest-AttachVolumeTestJSON-899158441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7c8dfde4-46ec-4f6c-b24e-a458b8985c14 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:32 devstack sudo[92505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7c8dfde4-46ec-4f6c-b24e-a458b8985c14 Jul 14 12:59:32 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:32 devstack sudo[92503]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-744af1eb-590c-4723-9097-7e725e8cc64c" returned: 0 in 0.748s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-744af1eb-590c-4723-9097-7e725e8cc64c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:32 devstack sudo[92510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-744af1eb-590c-4723-9097-7e725e8cc64c Jul 14 12:59:32 devstack sudo[92510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:33 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-721512f7-e8a9-4f2a-8073-a0b19d028809 tempest-AttachVolumeTestJSON-899158441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7c8dfde4-46ec-4f6c-b24e-a458b8985c14" returned: 0 in 0.678s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:33 devstack sudo[92510]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-721512f7-e8a9-4f2a-8073-a0b19d028809 tempest-AttachVolumeTestJSON-899158441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7c8dfde4-46ec-4f6c-b24e-a458b8985c14 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-744af1eb-590c-4723-9097-7e725e8cc64c" returned: 0 in 0.452s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:33 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7c8dfde4-46ec-4f6c-b24e-a458b8985c14 Jul 14 12:59:33 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Lock "cinder-quobyte-744af1eb-590c-4723-9097-7e725e8cc64c" released by "delete_volume" :: held 1.336s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:59:33 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Created reservations ['bd1b6f5c-fddf-459a-a28c-044f6adcc07a'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 12:59:33 devstack cinder-volume[86977]: WARNING cinder.quota [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-42880289 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-42880289, it is now deprecated. Please use the default quota class for default quota. Jul 14 12:59:33 devstack cinder-volume[86977]: WARNING cinder.quota [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-42880289 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-42880289, it is now deprecated. Please use the default quota class for default quota. Jul 14 12:59:33 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Created reservations ['16ebe2aa-822a-4318-a742-522e0a2b2cf4', '22e179da-f7f8-4491-858d-d37e67f30a87', '77f6a0ed-ec67-4195-a9a8-1aacce6f3e64', '748b1780-048e-4b5b-a48e-564a0237d6d1'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 12:59:33 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-721512f7-e8a9-4f2a-8073-a0b19d028809 tempest-AttachVolumeTestJSON-899158441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7c8dfde4-46ec-4f6c-b24e-a458b8985c14" returned: 0 in 0.460s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-721512f7-e8a9-4f2a-8073-a0b19d028809 tempest-AttachVolumeTestJSON-899158441 None] Lock "cinder-quobyte-7c8dfde4-46ec-4f6c-b24e-a458b8985c14" released by "delete_volume" :: held 1.202s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:59:33 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Created reservations ['8658e587-0ae4-4b01-a2dc-bb49a6b0b61c', '1097d7f6-9fd3-4322-8d87-a87cc8d716b9', 'd9af613f-37cc-48fa-9260-37129b1d28ea', '1fbc6d53-d57c-42c5-904a-293d210d262c'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 12:59:33 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-721512f7-e8a9-4f2a-8073-a0b19d028809 tempest-AttachVolumeTestJSON-899158441 None] Created reservations ['fd3881e5-f6ea-404d-a707-98fcc7e18851', '6ad25655-27f2-4a56-a813-88b97ff576d3', '2200648c-0061-4fd7-8684-1e3e328502f2', 'bdbdaa56-1a3f-42ad-9f20-a475e4d6a961'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 12:59:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-721512f7-e8a9-4f2a-8073-a0b19d028809 tempest-AttachVolumeTestJSON-899158441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-721512f7-e8a9-4f2a-8073-a0b19d028809 tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-721512f7-e8a9-4f2a-8073-a0b19d028809 tempest-AttachVolumeTestJSON-899158441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:59:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-721512f7-e8a9-4f2a-8073-a0b19d028809 tempest-AttachVolumeTestJSON-899158441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:59:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-721512f7-e8a9-4f2a-8073-a0b19d028809 tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-721512f7-e8a9-4f2a-8073-a0b19d028809 tempest-AttachVolumeTestJSON-899158441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:33 devstack sudo[92521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:59:33 devstack sudo[92521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:59:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:59:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:34 devstack sudo[92523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:59:34 devstack sudo[92523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:34 devstack sudo[92523]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.356s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:34 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:59:34 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c5eb2e8b-85d9-4c3f-a56b-df1c8c184bff tempest-GroupsTest-959755239 None] Delete group completed successfully. Jul 14 12:59:34 devstack sudo[92521]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-721512f7-e8a9-4f2a-8073-a0b19d028809 tempest-AttachVolumeTestJSON-899158441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.501s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:34 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-721512f7-e8a9-4f2a-8073-a0b19d028809 tempest-AttachVolumeTestJSON-899158441 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:59:34 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-721512f7-e8a9-4f2a-8073-a0b19d028809 tempest-AttachVolumeTestJSON-899158441 None] Deleted volume successfully. Jul 14 12:59:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-721512f7-e8a9-4f2a-8073-a0b19d028809 tempest-AttachVolumeTestJSON-899158441 None] Lock "cinder-7c8dfde4-46ec-4f6c-b24e-a458b8985c14-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:59:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d26ae832-8cbe-413b-8299-2edcacf7a788 tempest-AttachVolumeTestJSON-899158441 None] Acquiring lock "cinder-7681828a-bea8-4385-b636-6f1813b1451b-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:59:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d26ae832-8cbe-413b-8299-2edcacf7a788 tempest-AttachVolumeTestJSON-899158441 None] Lock "cinder-7681828a-bea8-4385-b636-6f1813b1451b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:59:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d26ae832-8cbe-413b-8299-2edcacf7a788 tempest-AttachVolumeTestJSON-899158441 None] Acquiring lock "cinder-quobyte-7681828a-bea8-4385-b636-6f1813b1451b" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:59:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d26ae832-8cbe-413b-8299-2edcacf7a788 tempest-AttachVolumeTestJSON-899158441 None] Lock "cinder-quobyte-7681828a-bea8-4385-b636-6f1813b1451b" acquired by "delete_volume" :: waited 0.032s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:59:34 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a517471-e416-42a7-af32-13df88eb6b16]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:59:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d26ae832-8cbe-413b-8299-2edcacf7a788 tempest-AttachVolumeTestJSON-899158441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7681828a-bea8-4385-b636-6f1813b1451b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:35 devstack sudo[92529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7681828a-bea8-4385-b636-6f1813b1451b Jul 14 12:59:35 devstack sudo[92529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:35 devstack sudo[92529]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d26ae832-8cbe-413b-8299-2edcacf7a788 tempest-AttachVolumeTestJSON-899158441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7681828a-bea8-4385-b636-6f1813b1451b" returned: 0 in 0.580s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d26ae832-8cbe-413b-8299-2edcacf7a788 tempest-AttachVolumeTestJSON-899158441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7681828a-bea8-4385-b636-6f1813b1451b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:35 devstack sudo[92536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7681828a-bea8-4385-b636-6f1813b1451b Jul 14 12:59:35 devstack sudo[92536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:35 devstack sudo[92536]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d26ae832-8cbe-413b-8299-2edcacf7a788 tempest-AttachVolumeTestJSON-899158441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7681828a-bea8-4385-b636-6f1813b1451b" returned: 0 in 0.434s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:35 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d26ae832-8cbe-413b-8299-2edcacf7a788 tempest-AttachVolumeTestJSON-899158441 None] Lock "cinder-quobyte-7681828a-bea8-4385-b636-6f1813b1451b" released by "delete_volume" :: held 1.078s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:59:36 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-d26ae832-8cbe-413b-8299-2edcacf7a788 tempest-AttachVolumeTestJSON-899158441 None] Created reservations ['dfd79cfe-2906-406c-90d8-a1716c343e31', '7d307641-e8d3-4718-9b05-235eba14922c', 'fd01a0d4-0147-4798-8a76-dc5aed26cc35', '9e13e2ad-39ac-4c68-8a97-71e71f633733'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 12:59:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d26ae832-8cbe-413b-8299-2edcacf7a788 tempest-AttachVolumeTestJSON-899158441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d26ae832-8cbe-413b-8299-2edcacf7a788 tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d26ae832-8cbe-413b-8299-2edcacf7a788 tempest-AttachVolumeTestJSON-899158441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:59:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d26ae832-8cbe-413b-8299-2edcacf7a788 tempest-AttachVolumeTestJSON-899158441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:59:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d26ae832-8cbe-413b-8299-2edcacf7a788 tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d26ae832-8cbe-413b-8299-2edcacf7a788 tempest-AttachVolumeTestJSON-899158441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:36 devstack sudo[92539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:59:36 devstack sudo[92539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:36 devstack sudo[92539]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d26ae832-8cbe-413b-8299-2edcacf7a788 tempest-AttachVolumeTestJSON-899158441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.361s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:36 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-d26ae832-8cbe-413b-8299-2edcacf7a788 tempest-AttachVolumeTestJSON-899158441 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:59:36 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-d26ae832-8cbe-413b-8299-2edcacf7a788 tempest-AttachVolumeTestJSON-899158441 None] Deleted volume successfully. Jul 14 12:59:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d26ae832-8cbe-413b-8299-2edcacf7a788 tempest-AttachVolumeTestJSON-899158441 None] Lock "cinder-7681828a-bea8-4385-b636-6f1813b1451b-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:59:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-051fc2fd-b554-4507-9df8-49d8eed71269 tempest-AttachVolumeTestJSON-899158441 None] Acquiring lock "cinder-dd74ed1d-49fc-4e7f-a236-eef83649e900-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:59:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-051fc2fd-b554-4507-9df8-49d8eed71269 tempest-AttachVolumeTestJSON-899158441 None] Lock "cinder-dd74ed1d-49fc-4e7f-a236-eef83649e900-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:59:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-051fc2fd-b554-4507-9df8-49d8eed71269 tempest-AttachVolumeTestJSON-899158441 None] Acquiring lock "cinder-quobyte-dd74ed1d-49fc-4e7f-a236-eef83649e900" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:59:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-051fc2fd-b554-4507-9df8-49d8eed71269 tempest-AttachVolumeTestJSON-899158441 None] Lock "cinder-quobyte-dd74ed1d-49fc-4e7f-a236-eef83649e900" acquired by "delete_volume" :: waited 0.024s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:59:37 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2a0d45-53fc-4724-9370-56730c395e6f]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:59:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-051fc2fd-b554-4507-9df8-49d8eed71269 tempest-AttachVolumeTestJSON-899158441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd74ed1d-49fc-4e7f-a236-eef83649e900 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:37 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd74ed1d-49fc-4e7f-a236-eef83649e900 Jul 14 12:59:37 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:38 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-051fc2fd-b554-4507-9df8-49d8eed71269 tempest-AttachVolumeTestJSON-899158441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd74ed1d-49fc-4e7f-a236-eef83649e900" returned: 0 in 0.509s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-051fc2fd-b554-4507-9df8-49d8eed71269 tempest-AttachVolumeTestJSON-899158441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd74ed1d-49fc-4e7f-a236-eef83649e900 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:38 devstack sudo[92548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd74ed1d-49fc-4e7f-a236-eef83649e900 Jul 14 12:59:38 devstack sudo[92548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:38 devstack sudo[92548]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-051fc2fd-b554-4507-9df8-49d8eed71269 tempest-AttachVolumeTestJSON-899158441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd74ed1d-49fc-4e7f-a236-eef83649e900" returned: 0 in 0.313s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-051fc2fd-b554-4507-9df8-49d8eed71269 tempest-AttachVolumeTestJSON-899158441 None] Lock "cinder-quobyte-dd74ed1d-49fc-4e7f-a236-eef83649e900" released by "delete_volume" :: held 0.890s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:59:38 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-051fc2fd-b554-4507-9df8-49d8eed71269 tempest-AttachVolumeTestJSON-899158441 None] Created reservations ['0ad61223-ecaa-4aec-b757-41c22702a7d3', '9e390341-85f7-452f-a9be-732e13703038', 'bceef468-fb0b-4b70-8475-d7af065afb0d', '8f62e237-8c1b-4c91-bd99-543f22c2602f'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 12:59:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-051fc2fd-b554-4507-9df8-49d8eed71269 tempest-AttachVolumeTestJSON-899158441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-051fc2fd-b554-4507-9df8-49d8eed71269 tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-051fc2fd-b554-4507-9df8-49d8eed71269 tempest-AttachVolumeTestJSON-899158441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:59:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-051fc2fd-b554-4507-9df8-49d8eed71269 tempest-AttachVolumeTestJSON-899158441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:59:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-051fc2fd-b554-4507-9df8-49d8eed71269 tempest-AttachVolumeTestJSON-899158441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-051fc2fd-b554-4507-9df8-49d8eed71269 tempest-AttachVolumeTestJSON-899158441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:38 devstack sudo[92551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:59:38 devstack sudo[92551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:38 devstack sudo[92551]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-051fc2fd-b554-4507-9df8-49d8eed71269 tempest-AttachVolumeTestJSON-899158441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.409s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:38 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-051fc2fd-b554-4507-9df8-49d8eed71269 tempest-AttachVolumeTestJSON-899158441 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:59:38 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-051fc2fd-b554-4507-9df8-49d8eed71269 tempest-AttachVolumeTestJSON-899158441 None] Deleted volume successfully. Jul 14 12:59:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-051fc2fd-b554-4507-9df8-49d8eed71269 tempest-AttachVolumeTestJSON-899158441 None] Lock "cinder-dd74ed1d-49fc-4e7f-a236-eef83649e900-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Flow 'volume_create_manager' (e0cd56ef-9c8f-4175-8ee2-dab4654fc960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4baeae44-2b10-4b8d-be12-3b46f96baa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4baeae44-2b10-4b8d-be12-3b46f96baa23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1337766366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f49abd03-f90f-4247-9aa3-9c0c41944333,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2a189252daab4ce0900b9e9318d3ac2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:59:42Z,use_quota=True,user_id='06b8184bb1cc497893000654882dae33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32031818-7555-4c04-8914-c573aae3461f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32031818-7555-4c04-8914-c573aae3461f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0300cafa-cefb-46c7-b1e0-a51823d1a221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0300cafa-cefb-46c7-b1e0-a51823d1a221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f49abd03-f90f-4247-9aa3-9c0c41944333', 'volume_name': 'volume-f49abd03-f90f-4247-9aa3-9c0c41944333', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fefabb5-00a8-42dc-b589-0ccaa6723606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fefabb5-00a8-42dc-b589-0ccaa6723606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360cd28f-62be-4e8e-b686-0ff8ec3dd36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:42 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Volume f49abd03-f90f-4247-9aa3-9c0c41944333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f49abd03-f90f-4247-9aa3-9c0c41944333', 'volume_size': 1} Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1337766366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f49abd03-f90f-4247-9aa3-9c0c41944333,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2a189252daab4ce0900b9e9318d3ac2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:59:42Z,use_quota=True,user_id='06b8184bb1cc497893000654882dae33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Creating volume f49abd03-f90f-4247-9aa3-9c0c41944333 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 12:59:42 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f49abd03-f90f-4247-9aa3-9c0c41944333 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:42 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f49abd03-f90f-4247-9aa3-9c0c41944333 1073741824 Jul 14 12:59:42 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:42 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-a5bee4a3-7718-4af3-bca8-cf0827d6e563 tempest-GroupsV320Test-1378428621 None] Group tempest-GroupsV320Test-Group-942649656: creating Jul 14 12:59:42 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-a5bee4a3-7718-4af3-bca8-cf0827d6e563 tempest-GroupsV320Test-1378428621 None] Group tempest-GroupsV320Test-Group-942649656: created successfully Jul 14 12:59:42 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-a5bee4a3-7718-4af3-bca8-cf0827d6e563 tempest-GroupsV320Test-1378428621 None] Create group completed successfully. Jul 14 12:59:42 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f49abd03-f90f-4247-9aa3-9c0c41944333 1073741824" returned: 0 in 0.558s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f49abd03-f90f-4247-9aa3-9c0c41944333 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:42 devstack sudo[92561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f49abd03-f90f-4247-9aa3-9c0c41944333 Jul 14 12:59:42 devstack sudo[92561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:43 devstack sudo[92561]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f49abd03-f90f-4247-9aa3-9c0c41944333" returned: 0 in 0.325s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:43 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 12:59:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:43 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360cd28f-62be-4e8e-b686-0ff8ec3dd36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f49abd03-f90f-4247-9aa3-9c0c41944333', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:43 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c5ddc2-95eb-4e87-84fc-ed4398b26c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:43 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Volume volume-f49abd03-f90f-4247-9aa3-9c0c41944333 (f49abd03-f90f-4247-9aa3-9c0c41944333): created successfully Jul 14 12:59:43 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c5ddc2-95eb-4e87-84fc-ed4398b26c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:43 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Flow 'volume_create_manager' (e0cd56ef-9c8f-4175-8ee2-dab4654fc960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:59:43 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-ecb5ce4b-c579-4130-bc22-fc26936963d6 req-d9d9907d-add4-49cd-ae32-429649030f20 tempest-VolumesGetTestJSON-757073009 None] Created volume successfully. Jul 14 12:59:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-70c27531-8b5d-4b43-9831-3756e213d345 req-b5e570c8-a780-4aed-91c3-0efc24be8d7d tempest-VolumesGetTestJSON-757073009 None] Acquiring lock "cinder-f49abd03-f90f-4247-9aa3-9c0c41944333-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:59:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-70c27531-8b5d-4b43-9831-3756e213d345 req-b5e570c8-a780-4aed-91c3-0efc24be8d7d tempest-VolumesGetTestJSON-757073009 None] Lock "cinder-f49abd03-f90f-4247-9aa3-9c0c41944333-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:59:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-70c27531-8b5d-4b43-9831-3756e213d345 req-b5e570c8-a780-4aed-91c3-0efc24be8d7d tempest-VolumesGetTestJSON-757073009 None] Acquiring lock "cinder-quobyte-f49abd03-f90f-4247-9aa3-9c0c41944333" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 12:59:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-70c27531-8b5d-4b43-9831-3756e213d345 req-b5e570c8-a780-4aed-91c3-0efc24be8d7d tempest-VolumesGetTestJSON-757073009 None] Lock "cinder-quobyte-f49abd03-f90f-4247-9aa3-9c0c41944333" acquired by "delete_volume" :: waited 0.036s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 12:59:44 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[258021ef-ded7-4754-8605-fd92f48e55c2]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:59:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-70c27531-8b5d-4b43-9831-3756e213d345 req-b5e570c8-a780-4aed-91c3-0efc24be8d7d tempest-VolumesGetTestJSON-757073009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f49abd03-f90f-4247-9aa3-9c0c41944333 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:44 devstack sudo[92590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f49abd03-f90f-4247-9aa3-9c0c41944333 Jul 14 12:59:44 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:44 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-70c27531-8b5d-4b43-9831-3756e213d345 req-b5e570c8-a780-4aed-91c3-0efc24be8d7d tempest-VolumesGetTestJSON-757073009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f49abd03-f90f-4247-9aa3-9c0c41944333" returned: 0 in 0.523s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-70c27531-8b5d-4b43-9831-3756e213d345 req-b5e570c8-a780-4aed-91c3-0efc24be8d7d tempest-VolumesGetTestJSON-757073009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f49abd03-f90f-4247-9aa3-9c0c41944333 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:44 devstack sudo[92596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f49abd03-f90f-4247-9aa3-9c0c41944333 Jul 14 12:59:44 devstack sudo[92596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:44 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-cdd5f9f0-2d50-4d34-a1a4-ff1286b38212 tempest-GroupsV320Test-1378428621 None] Created reservations ['8fe50157-9e5e-4b4b-98d1-a3a886d748c5'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 12:59:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-cdd5f9f0-2d50-4d34-a1a4-ff1286b38212 tempest-GroupsV320Test-1378428621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-cdd5f9f0-2d50-4d34-a1a4-ff1286b38212 tempest-GroupsV320Test-1378428621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:44 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-cdd5f9f0-2d50-4d34-a1a4-ff1286b38212 tempest-GroupsV320Test-1378428621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:59:44 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-cdd5f9f0-2d50-4d34-a1a4-ff1286b38212 tempest-GroupsV320Test-1378428621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:59:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-cdd5f9f0-2d50-4d34-a1a4-ff1286b38212 tempest-GroupsV320Test-1378428621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cdd5f9f0-2d50-4d34-a1a4-ff1286b38212 tempest-GroupsV320Test-1378428621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:44 devstack sudo[92598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:59:44 devstack sudo[92598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:44 devstack sudo[92596]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-70c27531-8b5d-4b43-9831-3756e213d345 req-b5e570c8-a780-4aed-91c3-0efc24be8d7d tempest-VolumesGetTestJSON-757073009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f49abd03-f90f-4247-9aa3-9c0c41944333" returned: 0 in 0.262s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:44 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-70c27531-8b5d-4b43-9831-3756e213d345 req-b5e570c8-a780-4aed-91c3-0efc24be8d7d tempest-VolumesGetTestJSON-757073009 None] Lock "cinder-quobyte-f49abd03-f90f-4247-9aa3-9c0c41944333" released by "delete_volume" :: held 0.844s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:59:44 devstack cinder-volume[86977]: DEBUG cinder.quota [req-70c27531-8b5d-4b43-9831-3756e213d345 req-b5e570c8-a780-4aed-91c3-0efc24be8d7d tempest-VolumesGetTestJSON-757073009 None] Created reservations ['880d8c95-f518-445f-b495-0eff7709b4f3', '90bd19f4-add9-4201-865b-ff6ebf19bb19', '861fe42f-e7bd-4322-a35a-97afb517f6e1', '2720de5a-61b6-4287-85b3-981cf6b9f6a2'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 12:59:44 devstack sudo[92598]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cdd5f9f0-2d50-4d34-a1a4-ff1286b38212 tempest-GroupsV320Test-1378428621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.285s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:44 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-cdd5f9f0-2d50-4d34-a1a4-ff1286b38212 tempest-GroupsV320Test-1378428621 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:59:44 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-cdd5f9f0-2d50-4d34-a1a4-ff1286b38212 tempest-GroupsV320Test-1378428621 None] Delete group completed successfully. Jul 14 12:59:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-70c27531-8b5d-4b43-9831-3756e213d345 req-b5e570c8-a780-4aed-91c3-0efc24be8d7d tempest-VolumesGetTestJSON-757073009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-70c27531-8b5d-4b43-9831-3756e213d345 req-b5e570c8-a780-4aed-91c3-0efc24be8d7d tempest-VolumesGetTestJSON-757073009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:44 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [req-70c27531-8b5d-4b43-9831-3756e213d345 req-b5e570c8-a780-4aed-91c3-0efc24be8d7d tempest-VolumesGetTestJSON-757073009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:59:44 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [req-70c27531-8b5d-4b43-9831-3756e213d345 req-b5e570c8-a780-4aed-91c3-0efc24be8d7d tempest-VolumesGetTestJSON-757073009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:59:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-70c27531-8b5d-4b43-9831-3756e213d345 req-b5e570c8-a780-4aed-91c3-0efc24be8d7d tempest-VolumesGetTestJSON-757073009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-70c27531-8b5d-4b43-9831-3756e213d345 req-b5e570c8-a780-4aed-91c3-0efc24be8d7d tempest-VolumesGetTestJSON-757073009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:45 devstack sudo[92603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 12:59:45 devstack sudo[92603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:45 devstack sudo[92603]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-70c27531-8b5d-4b43-9831-3756e213d345 req-b5e570c8-a780-4aed-91c3-0efc24be8d7d tempest-VolumesGetTestJSON-757073009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.278s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:45 devstack cinder-volume[86977]: DEBUG cinder.manager [req-70c27531-8b5d-4b43-9831-3756e213d345 req-b5e570c8-a780-4aed-91c3-0efc24be8d7d tempest-VolumesGetTestJSON-757073009 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 12:59:45 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-70c27531-8b5d-4b43-9831-3756e213d345 req-b5e570c8-a780-4aed-91c3-0efc24be8d7d tempest-VolumesGetTestJSON-757073009 None] Deleted volume successfully. Jul 14 12:59:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-70c27531-8b5d-4b43-9831-3756e213d345 req-b5e570c8-a780-4aed-91c3-0efc24be8d7d tempest-VolumesGetTestJSON-757073009 None] Lock "cinder-f49abd03-f90f-4247-9aa3-9c0c41944333-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 12:59:49 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-29645f85-c6b7-4d3d-8cb6-f644a79e2dff tempest-GroupSnapshotsTest-846013661 None] Group tempest-GroupSnapshotsTest-Group-19562122: creating Jul 14 12:59:49 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-29645f85-c6b7-4d3d-8cb6-f644a79e2dff tempest-GroupSnapshotsTest-846013661 None] Group tempest-GroupSnapshotsTest-Group-19562122: created successfully Jul 14 12:59:49 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-29645f85-c6b7-4d3d-8cb6-f644a79e2dff tempest-GroupSnapshotsTest-846013661 None] Create group completed successfully. Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Flow 'volume_create_manager' (04a299d7-5869-4e08-9fa9-3a4be9a819c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008d371d-48fa-4c48-b395-5b5304bc3327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008d371d-48fa-4c48-b395-5b5304bc3327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2068223226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16571c8d-c6f6-4aad-8100-c607fd48b305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c8a8a29b0e24169af758b825c40672f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:59:51Z,use_quota=True,user_id='dfa60c14fd614d72b9f9c6766a655f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573888f1-72d4-471e-8ac8-eb7d5484b795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573888f1-72d4-471e-8ac8-eb7d5484b795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c09aea9-1d57-4bb1-8916-6fe1f33f42fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c09aea9-1d57-4bb1-8916-6fe1f33f42fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16571c8d-c6f6-4aad-8100-c607fd48b305', 'volume_name': 'volume-16571c8d-c6f6-4aad-8100-c607fd48b305', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae4e67d-bc65-4d6a-b0c0-9e0b1102fc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae4e67d-bc65-4d6a-b0c0-9e0b1102fc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2c409a-c907-45d1-bb61-edd9758a54b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:51 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Volume 16571c8d-c6f6-4aad-8100-c607fd48b305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16571c8d-c6f6-4aad-8100-c607fd48b305', 'volume_size': 1} Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2068223226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16571c8d-c6f6-4aad-8100-c607fd48b305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c8a8a29b0e24169af758b825c40672f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:59:51Z,use_quota=True,user_id='dfa60c14fd614d72b9f9c6766a655f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Creating volume 16571c8d-c6f6-4aad-8100-c607fd48b305 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 12:59:51 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:51 devstack sudo[92608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305 1073741824 Jul 14 12:59:51 devstack sudo[92608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Flow 'volume_create_manager' (49600505-54d7-4a83-acc4-f9f7f36d31a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:59:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a6a51e-2bad-4cd2-a465-144ff28758ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a6a51e-2bad-4cd2-a465-144ff28758ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1899675792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=80079325-ec9a-45a8-8978-752c3587c2b1,host='devstack@QuobyteHD#QuobyteHD',id=92e0e838-d26f-46b9-8840-3f9dbf082f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ade236e81d44abca4bd35e961972d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:59:52Z,use_quota=True,user_id='3b0583a81d334ceea0343680506b84f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cc65deb-b383-4a4e-9727-019a2f249021),volume_type_id=8cc65deb-b383-4a4e-9727-019a2f249021)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e7f137-02ed-480e-85e6-e441945b140f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e7f137-02ed-480e-85e6-e441945b140f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32629cf9-fc04-464d-9137-7cc69bacec77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32629cf9-fc04-464d-9137-7cc69bacec77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92e0e838-d26f-46b9-8840-3f9dbf082f2a', 'volume_name': 'volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a2c190-8878-42b9-a9f8-18f0cc43ceb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a2c190-8878-42b9-a9f8-18f0cc43ceb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c26fe5d1-59bb-46c4-aeb8-0c33b6c027fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:52 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Volume 92e0e838-d26f-46b9-8840-3f9dbf082f2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a', 'volume_size': 1} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:52 devstack sudo[92608]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305 1073741824" returned: 0 in 0.508s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:52 devstack sudo[92613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305 Jul 14 12:59:52 devstack sudo[92613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:52 devstack sudo[92613]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305" returned: 0 in 0.294s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.494s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=80079325-ec9a-45a8-8978-752c3587c2b1,created_at=2026-07-14T10:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1899675792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=80079325-ec9a-45a8-8978-752c3587c2b1,host='devstack@QuobyteHD#QuobyteHD',id=92e0e838-d26f-46b9-8840-3f9dbf082f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ade236e81d44abca4bd35e961972d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:59:52Z,use_quota=True,user_id='3b0583a81d334ceea0343680506b84f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cc65deb-b383-4a4e-9727-019a2f249021),volume_type_id=8cc65deb-b383-4a4e-9727-019a2f249021)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Creating volume 92e0e838-d26f-46b9-8840-3f9dbf082f2a {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 12:59:52 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2c409a-c907-45d1-bb61-edd9758a54b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16571c8d-c6f6-4aad-8100-c607fd48b305', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:52 devstack sudo[92616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a 1073741824 Jul 14 12:59:52 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09e672e-5bc8-43ec-b397-8aa1060429ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:52 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Volume volume-16571c8d-c6f6-4aad-8100-c607fd48b305 (16571c8d-c6f6-4aad-8100-c607fd48b305): created successfully Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09e672e-5bc8-43ec-b397-8aa1060429ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Flow 'volume_create_manager' (04a299d7-5869-4e08-9fa9-3a4be9a819c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:59:52 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e5f0b7f1-49ed-4993-864c-106c3fba5d72 tempest-SnapshotsActionsTest-1698140824 None] Created volume successfully. Jul 14 12:59:53 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a 1073741824" returned: 0 in 0.650s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:53 devstack sudo[92622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a Jul 14 12:59:53 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:53 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a" returned: 0 in 0.370s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:53 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 12:59:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c26fe5d1-59bb-46c4-aeb8-0c33b6c027fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d155e417-f5b5-4fc5-9922-f4f651a832b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:53 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=92,cinder:INSERT=26,cinder:UPDATE=106,cinder:DELETE=5 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 12:59:53 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Volume volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a (92e0e838-d26f-46b9-8840-3f9dbf082f2a): created successfully Jul 14 12:59:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d155e417-f5b5-4fc5-9922-f4f651a832b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Flow 'volume_create_manager' (49600505-54d7-4a83-acc4-f9f7f36d31a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:59:53 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-2d27925e-5f70-43e6-9953-cb30c68a71e3 tempest-GroupSnapshotsTest-846013661 None] Created volume successfully. Jul 14 12:59:53 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=107,cinder:UPDATE=116,cinder:DELETE=9,cinder:INSERT=19 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 12:59:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-38061ede-da71-4049-8f01-1ce0737110e9 tempest-SnapshotsActionsTest-1698140824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-38061ede-da71-4049-8f01-1ce0737110e9 tempest-SnapshotsActionsTest-1698140824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:53 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-38061ede-da71-4049-8f01-1ce0737110e9 tempest-SnapshotsActionsTest-1698140824 None] Creating offline snapshot 356a0f5a-d405-4886-84c5-eaa2e490cdbf of volume 16571c8d-c6f6-4aad-8100-c607fd48b305 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 12:59:53 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[a751b611-5962-413d-b07a-fe875eced276]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:59:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38061ede-da71-4049-8f01-1ce0737110e9 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:54 devstack sudo[92625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305 Jul 14 12:59:54 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:54 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38061ede-da71-4049-8f01-1ce0737110e9 tempest-SnapshotsActionsTest-1698140824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305" returned: 0 in 0.502s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38061ede-da71-4049-8f01-1ce0737110e9 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:54 devstack sudo[92634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf 1G Jul 14 12:59:54 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:54 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c4b4f73f-0064-4594-ab77-b3fd51461d83 tempest-GroupSnapshotsTest-846013661 None] GroupSnapshot 15f44aee-dade-47e5-a844-bb598c3c606d: creating. Jul 14 12:59:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c4b4f73f-0064-4594-ab77-b3fd51461d83 tempest-GroupSnapshotsTest-846013661 None] Group snapshot 15f44aee-dade-47e5-a844-bb598c3c606d: creating. {{(pid=86977) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 14 12:59:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c4b4f73f-0064-4594-ab77-b3fd51461d83 tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:55 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38061ede-da71-4049-8f01-1ce0737110e9 tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf 1G" returned: 0 in 0.544s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38061ede-da71-4049-8f01-1ce0737110e9 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16571c8d-c6f6-4aad-8100-c607fd48b305 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:55 devstack sudo[92641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16571c8d-c6f6-4aad-8100-c607fd48b305 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf Jul 14 12:59:55 devstack sudo[92641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:55 devstack sudo[92641]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38061ede-da71-4049-8f01-1ce0737110e9 tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16571c8d-c6f6-4aad-8100-c607fd48b305 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf" returned: 0 in 0.377s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:55 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-38061ede-da71-4049-8f01-1ce0737110e9 tempest-SnapshotsActionsTest-1698140824 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf is being set with open permissions: ugo+rw Jul 14 12:59:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38061ede-da71-4049-8f01-1ce0737110e9 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:55 devstack sudo[92646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf Jul 14 12:59:55 devstack sudo[92646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:55 devstack sudo[92646]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38061ede-da71-4049-8f01-1ce0737110e9 tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf" returned: 0 in 0.326s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38061ede-da71-4049-8f01-1ce0737110e9 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:55 devstack sudo[92649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.info Jul 14 12:59:55 devstack sudo[92649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:55 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 12:59:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Flow 'volume_create_manager' (61ddf9d5-d76c-4842-bef1-6d30dfa44aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 12:59:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b181238-431e-4e4b-b637-e01927c67740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b181238-431e-4e4b-b637-e01927c67740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1599011289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c1c9e6-14ba-4804-8511-0c6c4afe8570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b37aa6cc1a4c453a843235b987120d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:59:56Z,use_quota=True,user_id='d30fef355c344bb8bd82c0b423cd4176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca599bf-613a-4e1a-9d50-da86dfaed8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca599bf-613a-4e1a-9d50-da86dfaed8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0e052a1-db5d-4554-881a-f6097b5d656d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0e052a1-db5d-4554-881a-f6097b5d656d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8c1c9e6-14ba-4804-8511-0c6c4afe8570', 'volume_name': 'volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b60582a-e3ef-4c49-aaa2-5f6098fb7ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b60582a-e3ef-4c49-aaa2-5f6098fb7ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 12:59:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185ae328-790e-4bae-9603-938cc46225f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 12:59:56 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Volume d8c1c9e6-14ba-4804-8511-0c6c4afe8570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570', 'volume_size': 1} Jul 14 12:59:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:56 devstack sudo[92649]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38061ede-da71-4049-8f01-1ce0737110e9 tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.info" returned: 0 in 0.345s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:56 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-38061ede-da71-4049-8f01-1ce0737110e9 tempest-SnapshotsActionsTest-1698140824 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.info is being set with open permissions: ugo+rw Jul 14 12:59:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38061ede-da71-4049-8f01-1ce0737110e9 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:56 devstack sudo[92652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.info Jul 14 12:59:56 devstack sudo[92652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:56 devstack sudo[92652]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38061ede-da71-4049-8f01-1ce0737110e9 tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.info" returned: 0 in 0.301s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-38061ede-da71-4049-8f01-1ce0737110e9 tempest-SnapshotsActionsTest-1698140824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.558s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c4b4f73f-0064-4594-ab77-b3fd51461d83 tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.842s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-c4b4f73f-0064-4594-ab77-b3fd51461d83 tempest-GroupSnapshotsTest-846013661 None] Creating offline snapshot 4d868588-5b04-4ee0-bafc-b91253da86b2 of volume 92e0e838-d26f-46b9-8840-3f9dbf082f2a {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 12:59:56 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-38061ede-da71-4049-8f01-1ce0737110e9 tempest-SnapshotsActionsTest-1698140824 None] Create snapshot completed successfully Jul 14 12:59:56 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17101e0-ec80-4075-ac09-48bdb0580d67]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 12:59:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c4b4f73f-0064-4594-ab77-b3fd51461d83 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:56 devstack sudo[92690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a Jul 14 12:59:56 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:57 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c4b4f73f-0064-4594-ab77-b3fd51461d83 tempest-GroupSnapshotsTest-846013661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a" returned: 0 in 0.569s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c4b4f73f-0064-4594-ab77-b3fd51461d83 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:57 devstack sudo[92697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2 1G Jul 14 12:59:57 devstack sudo[92697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-34406cda-b790-406f-abd3-924a57368b44 tempest-SnapshotsActionsTest-1698140824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:57 devstack sudo[92697]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c4b4f73f-0064-4594-ab77-b3fd51461d83 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2 1G" returned: 0 in 0.754s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c4b4f73f-0064-4594-ab77-b3fd51461d83 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:57 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2 Jul 14 12:59:57 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:58 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c4b4f73f-0064-4594-ab77-b3fd51461d83 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2" returned: 0 in 0.367s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:58 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-c4b4f73f-0064-4594-ab77-b3fd51461d83 tempest-GroupSnapshotsTest-846013661 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2 is being set with open permissions: ugo+rw: NotImplementedError Jul 14 12:59:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c4b4f73f-0064-4594-ab77-b3fd51461d83 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:58 devstack sudo[92707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2 Jul 14 12:59:58 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:58 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c4b4f73f-0064-4594-ab77-b3fd51461d83 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2" returned: 0 in 0.281s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c4b4f73f-0064-4594-ab77-b3fd51461d83 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:58 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.info Jul 14 12:59:58 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:58 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c4b4f73f-0064-4594-ab77-b3fd51461d83 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.info" returned: 0 in 0.321s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:58 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-c4b4f73f-0064-4594-ab77-b3fd51461d83 tempest-GroupSnapshotsTest-846013661 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 14 12:59:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c4b4f73f-0064-4594-ab77-b3fd51461d83 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:58 devstack sudo[92713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.info Jul 14 12:59:58 devstack sudo[92713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:59 devstack sudo[92713]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c4b4f73f-0064-4594-ab77-b3fd51461d83 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.info" returned: 0 in 0.271s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c4b4f73f-0064-4594-ab77-b3fd51461d83 tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.690s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.139s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T10:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1599011289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c1c9e6-14ba-4804-8511-0c6c4afe8570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b37aa6cc1a4c453a843235b987120d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T10:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T10:59:56Z,use_quota=True,user_id='d30fef355c344bb8bd82c0b423cd4176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 12:59:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Creating volume d8c1c9e6-14ba-4804-8511-0c6c4afe8570 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 12:59:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 12:59:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 12:59:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 12:59:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 12:59:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 12:59:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 12:59:59 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 12:59:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:59 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570 1073741824 Jul 14 12:59:59 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 12:59:59 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c4b4f73f-0064-4594-ab77-b3fd51461d83 tempest-GroupSnapshotsTest-846013661 None] group_snapshot 15f44aee-dade-47e5-a844-bb598c3c606d: created successfully Jul 14 12:59:59 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Jul 14 12:59:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570 1073741824" returned: 0 in 0.512s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 12:59:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 12:59:59 devstack sudo[92722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570 Jul 14 12:59:59 devstack sudo[92722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:00 devstack sudo[92722]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570" returned: 0 in 0.284s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:00:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-34406cda-b790-406f-abd3-924a57368b44 tempest-SnapshotsActionsTest-1698140824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.226s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-34406cda-b790-406f-abd3-924a57368b44 tempest-SnapshotsActionsTest-1698140824 None] Creating offline snapshot 4a8c630d-5146-447d-aae6-f101e818b975 of volume 16571c8d-c6f6-4aad-8100-c607fd48b305 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:00:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185ae328-790e-4bae-9603-938cc46225f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729a1d1c-17f2-4691-9186-45d2621d50ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:00 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c391267-d57e-44d6-bccf-ac2f93d852b8]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-34406cda-b790-406f-abd3-924a57368b44 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:00 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Volume volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570 (d8c1c9e6-14ba-4804-8511-0c6c4afe8570): created successfully Jul 14 13:00:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729a1d1c-17f2-4691-9186-45d2621d50ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Flow 'volume_create_manager' (61ddf9d5-d76c-4842-bef1-6d30dfa44aa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:00:00 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-83d2a752-1db9-4818-9acc-9640a8678a15 tempest-ServerActionsTestOtherA-1628124989 None] Created volume successfully. Jul 14 13:00:00 devstack sudo[92728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf Jul 14 13:00:00 devstack sudo[92728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:00 devstack sudo[92728]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-34406cda-b790-406f-abd3-924a57368b44 tempest-SnapshotsActionsTest-1698140824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf" returned: 0 in 0.444s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-34406cda-b790-406f-abd3-924a57368b44 tempest-SnapshotsActionsTest-1698140824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16571c8d-c6f6-4aad-8100-c607fd48b305(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:00:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-34406cda-b790-406f-abd3-924a57368b44 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4a8c630d-5146-447d-aae6-f101e818b975 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:00 devstack sudo[92734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4a8c630d-5146-447d-aae6-f101e818b975 1G Jul 14 13:00:00 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:01 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-34406cda-b790-406f-abd3-924a57368b44 tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4a8c630d-5146-447d-aae6-f101e818b975 1G" returned: 0 in 0.658s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-34406cda-b790-406f-abd3-924a57368b44 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4a8c630d-5146-447d-aae6-f101e818b975 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:01 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4a8c630d-5146-447d-aae6-f101e818b975 Jul 14 13:00:01 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:01 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-34406cda-b790-406f-abd3-924a57368b44 tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4a8c630d-5146-447d-aae6-f101e818b975" returned: 0 in 0.346s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:01 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-34406cda-b790-406f-abd3-924a57368b44 tempest-SnapshotsActionsTest-1698140824 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4a8c630d-5146-447d-aae6-f101e818b975 is being set with open permissions: ugo+rw Jul 14 13:00:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-34406cda-b790-406f-abd3-924a57368b44 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4a8c630d-5146-447d-aae6-f101e818b975 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:01 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4a8c630d-5146-447d-aae6-f101e818b975 Jul 14 13:00:01 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:01 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-34406cda-b790-406f-abd3-924a57368b44 tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4a8c630d-5146-447d-aae6-f101e818b975" returned: 0 in 0.335s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-34406cda-b790-406f-abd3-924a57368b44 tempest-SnapshotsActionsTest-1698140824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.151s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "cinder-quobyte-4d868588-5b04-4ee0-bafc-b91253da86b2-a410c7e5-43e3-4fea-8a34-f46506851d42" by "_create_volume_from_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-4d868588-5b04-4ee0-bafc-b91253da86b2-a410c7e5-43e3-4fea-8a34-f46506851d42" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Creating volume a410c7e5-43e3-4fea-8a34-f46506851d42 from snapshot 4d868588-5b04-4ee0-bafc-b91253da86b2 {{(pid=86977) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "cinder-quobyte-a410c7e5-43e3-4fea-8a34-f46506851d42" by "_copy_volume_from_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:02 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-34406cda-b790-406f-abd3-924a57368b44 tempest-SnapshotsActionsTest-1698140824 None] Create snapshot completed successfully Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-a410c7e5-43e3-4fea-8a34-f46506851d42" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] snapshot: 4d868588-5b04-4ee0-bafc-b91253da86b2, volume: a410c7e5-43e3-4fea-8a34-f46506851d42, {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[d275d3a8-82a6-47c5-a1ad-1f9f28d7c390]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:02 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2 Jul 14 13:00:02 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:02 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2" returned: 0 in 0.495s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Creating direct copy from snapshot {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e145d19-1937-4943-a095-96d6a87a1c2f]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:02 devstack sudo[92772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a Jul 14 13:00:02 devstack sudo[92772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:03 devstack sudo[92772]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a" returned: 0 in 0.614s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:03 devstack cinder-volume[86977]: DEBUG cinder.utils [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Path /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a410c7e5-43e3-4fea-8a34-f46506851d42 not found in is_blk_device check {{(pid=86977) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 13:00:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a410c7e5-43e3-4fea-8a34-f46506851d42 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:03 devstack sudo[92781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a410c7e5-43e3-4fea-8a34-f46506851d42 Jul 14 13:00:03 devstack sudo[92781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] Acquiring lock "cinder-4a8c630d-5146-447d-aae6-f101e818b975-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-4a8c630d-5146-447d-aae6-f101e818b975-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] Acquiring lock "cinder-quobyte-16571c8d-c6f6-4aad-8100-c607fd48b305" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-quobyte-16571c8d-c6f6-4aad-8100-c607fd48b305" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] Acquiring lock "cinder-quobyte-4a8c630d-5146-447d-aae6-f101e818b975" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-quobyte-4a8c630d-5146-447d-aae6-f101e818b975" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] Deleting offline snapshot 4a8c630d-5146-447d-aae6-f101e818b975 of volume 16571c8d-c6f6-4aad-8100-c607fd48b305 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:00:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] snapshot_file for this snap is: volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4a8c630d-5146-447d-aae6-f101e818b975 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:00:03 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dfbe30-234e-4802-ae13-f8534a274d4f]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4a8c630d-5146-447d-aae6-f101e818b975 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:03 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4a8c630d-5146-447d-aae6-f101e818b975 Jul 14 13:00:03 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:04 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4a8c630d-5146-447d-aae6-f101e818b975" returned: 0 in 0.798s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16571c8d-c6f6-4aad-8100-c607fd48b305(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:00:04 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[432b3c4d-0aee-416a-a5a1-c06b78a6b402]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:04 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf Jul 14 13:00:04 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:05 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf" returned: 0 in 1.086s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16571c8d-c6f6-4aad-8100-c607fd48b305(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:00:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4a8c630d-5146-447d-aae6-f101e818b975 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:05 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4a8c630d-5146-447d-aae6-f101e818b975 Jul 14 13:00:05 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:06 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4a8c630d-5146-447d-aae6-f101e818b975" returned: 0 in 1.436s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4a8c630d-5146-447d-aae6-f101e818b975 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:07 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4a8c630d-5146-447d-aae6-f101e818b975 Jul 14 13:00:07 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:07 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4a8c630d-5146-447d-aae6-f101e818b975" returned: 0 in 0.641s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-quobyte-4a8c630d-5146-447d-aae6-f101e818b975" released by "_delete_snapshot" :: held 4.208s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-quobyte-16571c8d-c6f6-4aad-8100-c607fd48b305" released by "delete_snapshot" :: held 4.253s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:07 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] Created reservations ['f6e70668-397e-44eb-b322-a7f0df373495', '720631b3-d76d-44eb-bd30-569ec03b5b9c', '29ee01cb-821c-4fb9-8008-f957cc008c04', 'b4884133-c776-4355-9109-10ba9424dc2a'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:00:08 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] Delete snapshot completed successfully. Jul 14 13:00:08 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-83a7d9b9-7448-4c97-bf99-70aefa2da162 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-4a8c630d-5146-447d-aae6-f101e818b975-delete_snapshot" released by "delete_snapshot" :: held 4.665s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:09 devstack sudo[92781]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a410c7e5-43e3-4fea-8a34-f46506851d42" returned: 0 in 6.727s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:10 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[075bf73b-a903-47f0-b11e-68305c2b670c]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5e86211b-7673-4638-af94-f8ea42c25d76 tempest-SnapshotsActionsTest-1698140824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:10 devstack sudo[92891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a Jul 14 13:00:10 devstack sudo[92891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:10 devstack sudo[92891]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a" returned: 0 in 0.733s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:10 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Image conversion details: src /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a, size 1024.00 MB, duration 6.73 sec, destination /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a410c7e5-43e3-4fea-8a34-f46506851d42 {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:00:10 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Converted 1024.00 MB image at 152.19 MB/s Jul 14 13:00:10 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a410c7e5-43e3-4fea-8a34-f46506851d42 is being set with open permissions: ugo+rw: NotImplementedError Jul 14 13:00:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a410c7e5-43e3-4fea-8a34-f46506851d42 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:10 devstack sudo[92898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a410c7e5-43e3-4fea-8a34-f46506851d42 Jul 14 13:00:10 devstack sudo[92898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:11 devstack sudo[92898]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a410c7e5-43e3-4fea-8a34-f46506851d42" returned: 0 in 0.497s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:11 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-a410c7e5-43e3-4fea-8a34-f46506851d42" released by "_copy_volume_from_snapshot" :: held 9.187s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:11 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-4d868588-5b04-4ee0-bafc-b91253da86b2-a410c7e5-43e3-4fea-8a34-f46506851d42" released by "_create_volume_from_snapshot" :: held 9.237s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.271s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5e86211b-7673-4638-af94-f8ea42c25d76 tempest-SnapshotsActionsTest-1698140824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.139s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-5e86211b-7673-4638-af94-f8ea42c25d76 tempest-SnapshotsActionsTest-1698140824 None] Creating offline snapshot 4b4c4080-db60-450c-8b32-30f53988a27f of volume 16571c8d-c6f6-4aad-8100-c607fd48b305 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:00:11 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2203273-cb7e-4304-914a-4dec90bc1878]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5e86211b-7673-4638-af94-f8ea42c25d76 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:11 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-38d0bdba-4766-4399-8748-69967eccfe4c tempest-GroupSnapshotsTest-846013661 None] Create group from source-snapshot-15f44aee-dade-47e5-a844-bb598c3c606d completed successfully. Jul 14 13:00:11 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf Jul 14 13:00:11 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:11 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5e86211b-7673-4638-af94-f8ea42c25d76 tempest-SnapshotsActionsTest-1698140824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf" returned: 0 in 0.500s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-5e86211b-7673-4638-af94-f8ea42c25d76 tempest-SnapshotsActionsTest-1698140824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16571c8d-c6f6-4aad-8100-c607fd48b305(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:00:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5e86211b-7673-4638-af94-f8ea42c25d76 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4b4c4080-db60-450c-8b32-30f53988a27f 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:11 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4b4c4080-db60-450c-8b32-30f53988a27f 1G Jul 14 13:00:11 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:13 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5e86211b-7673-4638-af94-f8ea42c25d76 tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4b4c4080-db60-450c-8b32-30f53988a27f 1G" returned: 0 in 1.347s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5e86211b-7673-4638-af94-f8ea42c25d76 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4b4c4080-db60-450c-8b32-30f53988a27f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:13 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4b4c4080-db60-450c-8b32-30f53988a27f Jul 14 13:00:13 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-537fcb9d-dd10-420a-9dd4-99cace1ee697 tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "cinder-quobyte-a410c7e5-43e3-4fea-8a34-f46506851d42" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-537fcb9d-dd10-420a-9dd4-99cace1ee697 tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-a410c7e5-43e3-4fea-8a34-f46506851d42" acquired by "delete_volume" :: waited 0.038s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:13 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1121a3-c5ea-4d49-bd97-cdd3bba0c822]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-537fcb9d-dd10-420a-9dd4-99cace1ee697 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a410c7e5-43e3-4fea-8a34-f46506851d42 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:13 devstack sudo[92981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a410c7e5-43e3-4fea-8a34-f46506851d42 Jul 14 13:00:13 devstack sudo[92981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:14 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5e86211b-7673-4638-af94-f8ea42c25d76 tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4b4c4080-db60-450c-8b32-30f53988a27f" returned: 0 in 0.799s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:14 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-5e86211b-7673-4638-af94-f8ea42c25d76 tempest-SnapshotsActionsTest-1698140824 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4b4c4080-db60-450c-8b32-30f53988a27f is being set with open permissions: ugo+rw Jul 14 13:00:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5e86211b-7673-4638-af94-f8ea42c25d76 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4b4c4080-db60-450c-8b32-30f53988a27f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:14 devstack sudo[92989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4b4c4080-db60-450c-8b32-30f53988a27f Jul 14 13:00:14 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:14 devstack sudo[92981]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-537fcb9d-dd10-420a-9dd4-99cace1ee697 tempest-GroupSnapshotsTest-846013661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a410c7e5-43e3-4fea-8a34-f46506851d42" returned: 0 in 0.743s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-537fcb9d-dd10-420a-9dd4-99cace1ee697 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a410c7e5-43e3-4fea-8a34-f46506851d42 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:14 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5e86211b-7673-4638-af94-f8ea42c25d76 tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4b4c4080-db60-450c-8b32-30f53988a27f" returned: 0 in 0.440s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:14 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a410c7e5-43e3-4fea-8a34-f46506851d42 Jul 14 13:00:14 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5e86211b-7673-4638-af94-f8ea42c25d76 tempest-SnapshotsActionsTest-1698140824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.251s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:14 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-5e86211b-7673-4638-af94-f8ea42c25d76 tempest-SnapshotsActionsTest-1698140824 None] Create snapshot completed successfully Jul 14 13:00:15 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-537fcb9d-dd10-420a-9dd4-99cace1ee697 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a410c7e5-43e3-4fea-8a34-f46506851d42" returned: 0 in 0.703s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-537fcb9d-dd10-420a-9dd4-99cace1ee697 tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-a410c7e5-43e3-4fea-8a34-f46506851d42" released by "delete_volume" :: held 1.593s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:15 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-537fcb9d-dd10-420a-9dd4-99cace1ee697 tempest-GroupSnapshotsTest-846013661 None] Created reservations ['f74efbac-9766-4f92-9fe3-06195db2b1f2'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:00:15 devstack cinder-volume[86977]: WARNING cinder.quota [None req-537fcb9d-dd10-420a-9dd4-99cace1ee697 tempest-GroupSnapshotsTest-846013661 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-988775619 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-988775619, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:00:15 devstack cinder-volume[86977]: WARNING cinder.quota [None req-537fcb9d-dd10-420a-9dd4-99cace1ee697 tempest-GroupSnapshotsTest-846013661 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-988775619 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-988775619, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:00:15 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-537fcb9d-dd10-420a-9dd4-99cace1ee697 tempest-GroupSnapshotsTest-846013661 None] Created reservations ['18c1182b-faf8-43e5-bda0-def4650da03e', 'd32e7a95-1532-42fd-b064-53fde4d1fff4', '1468e555-d43f-4cb1-a1ba-f5fbca9d245f', '4d5b81c8-dee3-4d31-b584-d71c4e945a22'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:00:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-537fcb9d-dd10-420a-9dd4-99cace1ee697 tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-537fcb9d-dd10-420a-9dd4-99cace1ee697 tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-537fcb9d-dd10-420a-9dd4-99cace1ee697 tempest-GroupSnapshotsTest-846013661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:00:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-537fcb9d-dd10-420a-9dd4-99cace1ee697 tempest-GroupSnapshotsTest-846013661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:00:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-537fcb9d-dd10-420a-9dd4-99cace1ee697 tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-537fcb9d-dd10-420a-9dd4-99cace1ee697 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:15 devstack sudo[93008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:00:15 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] Acquiring lock "cinder-4b4c4080-db60-450c-8b32-30f53988a27f-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-4b4c4080-db60-450c-8b32-30f53988a27f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.092s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] Acquiring lock "cinder-quobyte-16571c8d-c6f6-4aad-8100-c607fd48b305" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-quobyte-16571c8d-c6f6-4aad-8100-c607fd48b305" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] Acquiring lock "cinder-quobyte-4b4c4080-db60-450c-8b32-30f53988a27f" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-quobyte-4b4c4080-db60-450c-8b32-30f53988a27f" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] Deleting offline snapshot 4b4c4080-db60-450c-8b32-30f53988a27f of volume 16571c8d-c6f6-4aad-8100-c607fd48b305 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:00:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] snapshot_file for this snap is: volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4b4c4080-db60-450c-8b32-30f53988a27f {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:00:16 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b44db0-6762-446b-94e0-bfb38cdeb8d2]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4b4c4080-db60-450c-8b32-30f53988a27f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:16 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-537fcb9d-dd10-420a-9dd4-99cace1ee697 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.598s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-537fcb9d-dd10-420a-9dd4-99cace1ee697 tempest-GroupSnapshotsTest-846013661 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:00:16 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-537fcb9d-dd10-420a-9dd4-99cace1ee697 tempest-GroupSnapshotsTest-846013661 None] Delete group completed successfully. Jul 14 13:00:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:00:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:00:16 devstack sudo[93023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4b4c4080-db60-450c-8b32-30f53988a27f Jul 14 13:00:16 devstack sudo[93023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:00:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:16 devstack sudo[93030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:00:16 devstack sudo[93030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:16 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c81fd12b-febc-4f2d-b264-1f798f75239c tempest-GroupSnapshotsTest-846013661 None] group_snapshot 15f44aee-dade-47e5-a844-bb598c3c606d: deleting Jul 14 13:00:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c81fd12b-febc-4f2d-b264-1f798f75239c tempest-GroupSnapshotsTest-846013661 None] group_snapshot 15f44aee-dade-47e5-a844-bb598c3c606d: deleting {{(pid=86977) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 14 13:00:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c81fd12b-febc-4f2d-b264-1f798f75239c tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "cinder-quobyte-92e0e838-d26f-46b9-8840-3f9dbf082f2a" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c81fd12b-febc-4f2d-b264-1f798f75239c tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-92e0e838-d26f-46b9-8840-3f9dbf082f2a" acquired by "delete_snapshot" :: waited 0.073s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c81fd12b-febc-4f2d-b264-1f798f75239c tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "cinder-quobyte-4d868588-5b04-4ee0-bafc-b91253da86b2" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c81fd12b-febc-4f2d-b264-1f798f75239c tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-4d868588-5b04-4ee0-bafc-b91253da86b2" acquired by "_delete_snapshot" :: waited 0.075s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-c81fd12b-febc-4f2d-b264-1f798f75239c tempest-GroupSnapshotsTest-846013661 None] Deleting offline snapshot 4d868588-5b04-4ee0-bafc-b91253da86b2 of volume 92e0e838-d26f-46b9-8840-3f9dbf082f2a {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:00:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-c81fd12b-febc-4f2d-b264-1f798f75239c tempest-GroupSnapshotsTest-846013661 None] snapshot_file for this snap is: volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:00:17 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d8a403-4902-46c6-8d93-c248a8d7beaf]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c81fd12b-febc-4f2d-b264-1f798f75239c tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:17 devstack sudo[93030]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.954s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:17 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:00:17 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2 Jul 14 13:00:17 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:17 devstack sudo[93023]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4b4c4080-db60-450c-8b32-30f53988a27f" returned: 0 in 1.335s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16571c8d-c6f6-4aad-8100-c607fd48b305(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:00:17 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:00:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 8 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 13:00:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 13:00:17 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a701d5c-2259-4f97-96da-2936f9b046fa]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:17 devstack sudo[93038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf Jul 14 13:00:17 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:18 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c81fd12b-febc-4f2d-b264-1f798f75239c tempest-GroupSnapshotsTest-846013661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2" returned: 0 in 1.107s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-c81fd12b-febc-4f2d-b264-1f798f75239c tempest-GroupSnapshotsTest-846013661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:00:18 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e743f5-ad18-4eef-a489-791a3a6abe41]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c81fd12b-febc-4f2d-b264-1f798f75239c tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:18 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a Jul 14 13:00:18 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:18 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf" returned: 0 in 1.127s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16571c8d-c6f6-4aad-8100-c607fd48b305(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:00:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4b4c4080-db60-450c-8b32-30f53988a27f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:18 devstack sudo[93056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4b4c4080-db60-450c-8b32-30f53988a27f Jul 14 13:00:18 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:18 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c81fd12b-febc-4f2d-b264-1f798f75239c tempest-GroupSnapshotsTest-846013661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a" returned: 0 in 0.670s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c81fd12b-febc-4f2d-b264-1f798f75239c tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:19 devstack sudo[93062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2 Jul 14 13:00:19 devstack sudo[93062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:19 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4b4c4080-db60-450c-8b32-30f53988a27f" returned: 0 in 0.647s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4b4c4080-db60-450c-8b32-30f53988a27f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:19 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4b4c4080-db60-450c-8b32-30f53988a27f Jul 14 13:00:19 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:19 devstack sudo[93062]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c81fd12b-febc-4f2d-b264-1f798f75239c tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2" returned: 0 in 0.813s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c81fd12b-febc-4f2d-b264-1f798f75239c tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:19 devstack sudo[93074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2 Jul 14 13:00:19 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:19 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.4b4c4080-db60-450c-8b32-30f53988a27f" returned: 0 in 0.501s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-quobyte-4b4c4080-db60-450c-8b32-30f53988a27f" released by "_delete_snapshot" :: held 3.842s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-quobyte-16571c8d-c6f6-4aad-8100-c607fd48b305" released by "delete_snapshot" :: held 3.913s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:20 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] Created reservations ['f1b5aa23-85c1-4584-a11b-57e9d072d9b0', 'b27a44c8-1605-46c3-a0f6-6c959a4aced7', '4ca32de1-7a17-4d6c-a8bd-683c480329bc', '3001c984-9246-47de-9064-92621b86e5cf'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:00:20 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c81fd12b-febc-4f2d-b264-1f798f75239c tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a.4d868588-5b04-4ee0-bafc-b91253da86b2" returned: 0 in 0.399s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c81fd12b-febc-4f2d-b264-1f798f75239c tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-4d868588-5b04-4ee0-bafc-b91253da86b2" released by "_delete_snapshot" :: held 3.208s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:20 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] Delete snapshot completed successfully. Jul 14 13:00:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0d673e26-dbc4-4525-aead-08faa27667d6 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-4b4c4080-db60-450c-8b32-30f53988a27f-delete_snapshot" released by "delete_snapshot" :: held 4.262s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c81fd12b-febc-4f2d-b264-1f798f75239c tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-92e0e838-d26f-46b9-8840-3f9dbf082f2a" released by "delete_snapshot" :: held 3.305s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:20 devstack cinder-volume[86977]: WARNING cinder.quota [None req-c81fd12b-febc-4f2d-b264-1f798f75239c tempest-GroupSnapshotsTest-846013661 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-988775619 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-988775619, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:00:20 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-c81fd12b-febc-4f2d-b264-1f798f75239c tempest-GroupSnapshotsTest-846013661 None] Created reservations ['f9cefcd9-1a56-46f7-986f-6c82bb5375a5', '77e0b2c4-61f8-4cb9-ad77-b32f3a163981', '44d9bb87-0d30-4aba-be77-1b73bf0cbaeb', 'f1bdfd10-8450-4b38-afe8-9a48db73d99a'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:00:20 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c81fd12b-febc-4f2d-b264-1f798f75239c tempest-GroupSnapshotsTest-846013661 None] group_snapshot 15f44aee-dade-47e5-a844-bb598c3c606d: deleted successfully Jul 14 13:00:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6fc55bde-6069-41cf-856d-754008d02a1f tempest-SnapshotsActionsTest-1698140824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6fc55bde-6069-41cf-856d-754008d02a1f tempest-SnapshotsActionsTest-1698140824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-6fc55bde-6069-41cf-856d-754008d02a1f tempest-SnapshotsActionsTest-1698140824 None] Creating offline snapshot 1f0905b5-b100-43b9-bb15-c7e7cafff493 of volume 16571c8d-c6f6-4aad-8100-c607fd48b305 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:00:20 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb72c33-8ba3-42b2-a4e9-65e7ae3b32a6]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6fc55bde-6069-41cf-856d-754008d02a1f tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:21 devstack sudo[93077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf Jul 14 13:00:21 devstack sudo[93077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-86144e02-f7d3-47e1-87f7-62162d5ba99a tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "cinder-quobyte-92e0e838-d26f-46b9-8840-3f9dbf082f2a" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-86144e02-f7d3-47e1-87f7-62162d5ba99a tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-92e0e838-d26f-46b9-8840-3f9dbf082f2a" acquired by "delete_volume" :: waited 0.027s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:21 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af4339c-38eb-4212-85ca-8b4bf5e50264]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-86144e02-f7d3-47e1-87f7-62162d5ba99a tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:21 devstack sudo[93079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a Jul 14 13:00:21 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:21 devstack sudo[93077]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6fc55bde-6069-41cf-856d-754008d02a1f tempest-SnapshotsActionsTest-1698140824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf" returned: 0 in 0.599s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-6fc55bde-6069-41cf-856d-754008d02a1f tempest-SnapshotsActionsTest-1698140824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16571c8d-c6f6-4aad-8100-c607fd48b305(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:00:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6fc55bde-6069-41cf-856d-754008d02a1f tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.1f0905b5-b100-43b9-bb15-c7e7cafff493 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:21 devstack sudo[93084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.1f0905b5-b100-43b9-bb15-c7e7cafff493 1G Jul 14 13:00:21 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:21 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-86144e02-f7d3-47e1-87f7-62162d5ba99a tempest-GroupSnapshotsTest-846013661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a" returned: 0 in 0.534s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-86144e02-f7d3-47e1-87f7-62162d5ba99a tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:21 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a Jul 14 13:00:21 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:22 devstack sudo[93084]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6fc55bde-6069-41cf-856d-754008d02a1f tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.1f0905b5-b100-43b9-bb15-c7e7cafff493 1G" returned: 0 in 0.513s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6fc55bde-6069-41cf-856d-754008d02a1f tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.1f0905b5-b100-43b9-bb15-c7e7cafff493 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:22 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-86144e02-f7d3-47e1-87f7-62162d5ba99a tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92e0e838-d26f-46b9-8840-3f9dbf082f2a" returned: 0 in 0.359s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:22 devstack sudo[93096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.1f0905b5-b100-43b9-bb15-c7e7cafff493 Jul 14 13:00:22 devstack sudo[93096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-86144e02-f7d3-47e1-87f7-62162d5ba99a tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-92e0e838-d26f-46b9-8840-3f9dbf082f2a" released by "delete_volume" :: held 0.978s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:22 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-86144e02-f7d3-47e1-87f7-62162d5ba99a tempest-GroupSnapshotsTest-846013661 None] Created reservations ['970a3fe8-5721-4af4-83e4-398554867a12'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:00:22 devstack cinder-volume[86977]: WARNING cinder.db.api [None req-86144e02-f7d3-47e1-87f7-62162d5ba99a tempest-GroupSnapshotsTest-846013661 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-988775619'] Jul 14 13:00:22 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-86144e02-f7d3-47e1-87f7-62162d5ba99a tempest-GroupSnapshotsTest-846013661 None] Created reservations ['10699cd9-64bd-4e2a-b4e8-e9cfaf8dfbc1', '1d342a18-5d73-4896-b2ab-1d5d8ff3e4ab', '3ac8377e-0f05-4847-8c52-4bf1b1c15a9d', 'ec0d2142-9c92-4264-ab95-1a3270869773'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:00:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-86144e02-f7d3-47e1-87f7-62162d5ba99a tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-86144e02-f7d3-47e1-87f7-62162d5ba99a tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-86144e02-f7d3-47e1-87f7-62162d5ba99a tempest-GroupSnapshotsTest-846013661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:00:22 devstack sudo[93096]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-86144e02-f7d3-47e1-87f7-62162d5ba99a tempest-GroupSnapshotsTest-846013661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:00:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-86144e02-f7d3-47e1-87f7-62162d5ba99a tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-86144e02-f7d3-47e1-87f7-62162d5ba99a tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6fc55bde-6069-41cf-856d-754008d02a1f tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.1f0905b5-b100-43b9-bb15-c7e7cafff493" returned: 0 in 0.442s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:22 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-6fc55bde-6069-41cf-856d-754008d02a1f tempest-SnapshotsActionsTest-1698140824 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.1f0905b5-b100-43b9-bb15-c7e7cafff493 is being set with open permissions: ugo+rw Jul 14 13:00:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6fc55bde-6069-41cf-856d-754008d02a1f tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.1f0905b5-b100-43b9-bb15-c7e7cafff493 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:22 devstack sudo[93101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:00:22 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:22 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.1f0905b5-b100-43b9-bb15-c7e7cafff493 Jul 14 13:00:22 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:22 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6fc55bde-6069-41cf-856d-754008d02a1f tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.1f0905b5-b100-43b9-bb15-c7e7cafff493" returned: 0 in 0.271s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6fc55bde-6069-41cf-856d-754008d02a1f tempest-SnapshotsActionsTest-1698140824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:22 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-6fc55bde-6069-41cf-856d-754008d02a1f tempest-SnapshotsActionsTest-1698140824 None] Create snapshot completed successfully Jul 14 13:00:22 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-86144e02-f7d3-47e1-87f7-62162d5ba99a tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.376s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:22 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-86144e02-f7d3-47e1-87f7-62162d5ba99a tempest-GroupSnapshotsTest-846013661 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:00:22 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-86144e02-f7d3-47e1-87f7-62162d5ba99a tempest-GroupSnapshotsTest-846013661 None] Delete group completed successfully. Jul 14 13:00:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] Acquiring lock "cinder-1f0905b5-b100-43b9-bb15-c7e7cafff493-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-1f0905b5-b100-43b9-bb15-c7e7cafff493-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] Acquiring lock "cinder-quobyte-16571c8d-c6f6-4aad-8100-c607fd48b305" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-quobyte-16571c8d-c6f6-4aad-8100-c607fd48b305" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] Acquiring lock "cinder-quobyte-1f0905b5-b100-43b9-bb15-c7e7cafff493" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-quobyte-1f0905b5-b100-43b9-bb15-c7e7cafff493" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] Deleting offline snapshot 1f0905b5-b100-43b9-bb15-c7e7cafff493 of volume 16571c8d-c6f6-4aad-8100-c607fd48b305 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:00:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] snapshot_file for this snap is: volume-16571c8d-c6f6-4aad-8100-c607fd48b305.1f0905b5-b100-43b9-bb15-c7e7cafff493 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:00:23 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[580c1a75-f61b-4362-be87-6d8c9425195d]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.1f0905b5-b100-43b9-bb15-c7e7cafff493 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:23 devstack sudo[93107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.1f0905b5-b100-43b9-bb15-c7e7cafff493 Jul 14 13:00:23 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:23 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.1f0905b5-b100-43b9-bb15-c7e7cafff493" returned: 0 in 0.472s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16571c8d-c6f6-4aad-8100-c607fd48b305(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:00:23 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d73c970-87fe-4dfa-a1cb-25a0523feb7b]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:23 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf Jul 14 13:00:23 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:24 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-16832607-257f-4c8d-8032-4083f692b0e6 tempest-GroupSnapshotsTest-846013661 None] Group tempest-GroupSnapshotsTest-Group-1152190577: creating Jul 14 13:00:24 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-16832607-257f-4c8d-8032-4083f692b0e6 tempest-GroupSnapshotsTest-846013661 None] Group tempest-GroupSnapshotsTest-Group-1152190577: created successfully Jul 14 13:00:24 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-16832607-257f-4c8d-8032-4083f692b0e6 tempest-GroupSnapshotsTest-846013661 None] Create group completed successfully. Jul 14 13:00:24 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf" returned: 0 in 0.536s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16571c8d-c6f6-4aad-8100-c607fd48b305(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:00:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.1f0905b5-b100-43b9-bb15-c7e7cafff493 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:24 devstack sudo[93157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.1f0905b5-b100-43b9-bb15-c7e7cafff493 Jul 14 13:00:24 devstack sudo[93157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:24 devstack sudo[93157]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.1f0905b5-b100-43b9-bb15-c7e7cafff493" returned: 0 in 0.389s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.1f0905b5-b100-43b9-bb15-c7e7cafff493 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:24 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.1f0905b5-b100-43b9-bb15-c7e7cafff493 Jul 14 13:00:24 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:24 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.1f0905b5-b100-43b9-bb15-c7e7cafff493" returned: 0 in 0.243s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-quobyte-1f0905b5-b100-43b9-bb15-c7e7cafff493" released by "_delete_snapshot" :: held 1.741s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-quobyte-16571c8d-c6f6-4aad-8100-c607fd48b305" released by "delete_snapshot" :: held 1.767s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:25 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] Created reservations ['33549f05-75f8-416e-998e-26f3cce6c61a', 'ddf407fa-72dd-4b2d-95f4-bbec6a05dc70', '496ab222-632a-44d0-aea4-e8cd8dc7fb42', '124df5db-3f29-4750-bc72-936b239e53e9'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:00:25 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] Delete snapshot completed successfully. Jul 14 13:00:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e8709a22-872a-44b9-9fba-65f3671ec741 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-1f0905b5-b100-43b9-bb15-c7e7cafff493-delete_snapshot" released by "delete_snapshot" :: held 1.911s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-49a9745d-9c6e-44ca-877d-d0bb70d799e4 tempest-SnapshotsActionsTest-1698140824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-49a9745d-9c6e-44ca-877d-d0bb70d799e4 tempest-SnapshotsActionsTest-1698140824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-49a9745d-9c6e-44ca-877d-d0bb70d799e4 tempest-SnapshotsActionsTest-1698140824 None] Creating offline snapshot 66cb6fcb-8788-4222-933d-d20ad531a1ac of volume 16571c8d-c6f6-4aad-8100-c607fd48b305 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:00:25 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:00:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Flow 'volume_create_manager' (84669ea7-5d7d-4422-a50b-321354dae05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:00:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9afc5f63-412e-4690-b1e2-4f0f1a281dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:25 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4dc1c0-cc46-44de-b55f-e538097ccf00]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-49a9745d-9c6e-44ca-877d-d0bb70d799e4 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9afc5f63-412e-4690-b1e2-4f0f1a281dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1525952651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aea728aa-967a-4b4a-87e2-47d39ae380ea,host='devstack@QuobyteHD#QuobyteHD',id=b1ccccd0-c209-4904-9b52-3e073cf4373f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ade236e81d44abca4bd35e961972d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:00:26Z,use_quota=True,user_id='3b0583a81d334ceea0343680506b84f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef8fbd45-f0f5-46f7-a2f5-156d2c421be2),volume_type_id=ef8fbd45-f0f5-46f7-a2f5-156d2c421be2)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93988024-07aa-4580-ad52-ff6a7409a936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93988024-07aa-4580-ad52-ff6a7409a936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d9451d-55f3-4502-9e45-f9952b0df50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d9451d-55f3-4502-9e45-f9952b0df50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ccccd0-c209-4904-9b52-3e073cf4373f', 'volume_name': 'volume-b1ccccd0-c209-4904-9b52-3e073cf4373f', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e08e06a-2a41-480f-8a73-f5f7440a5709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e08e06a-2a41-480f-8a73-f5f7440a5709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91563d55-ca79-42a3-987c-80e112996fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:25 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Volume b1ccccd0-c209-4904-9b52-3e073cf4373f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ccccd0-c209-4904-9b52-3e073cf4373f', 'volume_size': 1} Jul 14 13:00:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:26 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf Jul 14 13:00:26 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:26 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-49a9745d-9c6e-44ca-877d-d0bb70d799e4 tempest-SnapshotsActionsTest-1698140824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf" returned: 0 in 0.362s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:26 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-49a9745d-9c6e-44ca-877d-d0bb70d799e4 tempest-SnapshotsActionsTest-1698140824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16571c8d-c6f6-4aad-8100-c607fd48b305(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:00:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-49a9745d-9c6e-44ca-877d-d0bb70d799e4 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.66cb6fcb-8788-4222-933d-d20ad531a1ac 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:26 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.66cb6fcb-8788-4222-933d-d20ad531a1ac 1G Jul 14 13:00:26 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:26 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-49a9745d-9c6e-44ca-877d-d0bb70d799e4 tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.66cb6fcb-8788-4222-933d-d20ad531a1ac 1G" returned: 0 in 0.441s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-49a9745d-9c6e-44ca-877d-d0bb70d799e4 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.66cb6fcb-8788-4222-933d-d20ad531a1ac {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:26 devstack sudo[93177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.66cb6fcb-8788-4222-933d-d20ad531a1ac Jul 14 13:00:26 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:27 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-49a9745d-9c6e-44ca-877d-d0bb70d799e4 tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.66cb6fcb-8788-4222-933d-d20ad531a1ac" returned: 0 in 0.338s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:27 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-49a9745d-9c6e-44ca-877d-d0bb70d799e4 tempest-SnapshotsActionsTest-1698140824 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.66cb6fcb-8788-4222-933d-d20ad531a1ac is being set with open permissions: ugo+rw Jul 14 13:00:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-49a9745d-9c6e-44ca-877d-d0bb70d799e4 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.66cb6fcb-8788-4222-933d-d20ad531a1ac {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:27 devstack sudo[93182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.66cb6fcb-8788-4222-933d-d20ad531a1ac Jul 14 13:00:27 devstack sudo[93182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:27 devstack sudo[93182]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-49a9745d-9c6e-44ca-877d-d0bb70d799e4 tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.66cb6fcb-8788-4222-933d-d20ad531a1ac" returned: 0 in 0.249s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-49a9745d-9c6e-44ca-877d-d0bb70d799e4 tempest-SnapshotsActionsTest-1698140824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.515s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.356s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aea728aa-967a-4b4a-87e2-47d39ae380ea,created_at=2026-07-14T11:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1525952651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aea728aa-967a-4b4a-87e2-47d39ae380ea,host='devstack@QuobyteHD#QuobyteHD',id=b1ccccd0-c209-4904-9b52-3e073cf4373f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ade236e81d44abca4bd35e961972d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:00:26Z,use_quota=True,user_id='3b0583a81d334ceea0343680506b84f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef8fbd45-f0f5-46f7-a2f5-156d2c421be2),volume_type_id=ef8fbd45-f0f5-46f7-a2f5-156d2c421be2)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:00:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Creating volume b1ccccd0-c209-4904-9b52-3e073cf4373f {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:00:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:00:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:00:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:00:27 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:00:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:27 devstack sudo[93185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f 1073741824 Jul 14 13:00:27 devstack sudo[93185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:27 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-49a9745d-9c6e-44ca-877d-d0bb70d799e4 tempest-SnapshotsActionsTest-1698140824 None] Create snapshot completed successfully Jul 14 13:00:27 devstack sudo[93185]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f 1073741824" returned: 0 in 0.494s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] Acquiring lock "cinder-66cb6fcb-8788-4222-933d-d20ad531a1ac-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:27 devstack sudo[93201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f Jul 14 13:00:27 devstack sudo[93201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-66cb6fcb-8788-4222-933d-d20ad531a1ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] Acquiring lock "cinder-quobyte-16571c8d-c6f6-4aad-8100-c607fd48b305" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-quobyte-16571c8d-c6f6-4aad-8100-c607fd48b305" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] Acquiring lock "cinder-quobyte-66cb6fcb-8788-4222-933d-d20ad531a1ac" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-quobyte-66cb6fcb-8788-4222-933d-d20ad531a1ac" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] Deleting offline snapshot 66cb6fcb-8788-4222-933d-d20ad531a1ac of volume 16571c8d-c6f6-4aad-8100-c607fd48b305 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:00:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] snapshot_file for this snap is: volume-16571c8d-c6f6-4aad-8100-c607fd48b305.66cb6fcb-8788-4222-933d-d20ad531a1ac {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:00:28 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[03804692-bd9f-4e48-8e04-4d164bd67f94]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.66cb6fcb-8788-4222-933d-d20ad531a1ac {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:28 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.66cb6fcb-8788-4222-933d-d20ad531a1ac Jul 14 13:00:28 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:28 devstack sudo[93201]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f" returned: 0 in 0.336s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:00:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91563d55-ca79-42a3-987c-80e112996fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ccccd0-c209-4904-9b52-3e073cf4373f', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (902397d5-c977-4757-ad24-c7aadd311a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:28 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Volume volume-b1ccccd0-c209-4904-9b52-3e073cf4373f (b1ccccd0-c209-4904-9b52-3e073cf4373f): created successfully Jul 14 13:00:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (902397d5-c977-4757-ad24-c7aadd311a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Flow 'volume_create_manager' (84669ea7-5d7d-4422-a50b-321354dae05f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:00:28 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-7304f024-a3ca-4cdb-9cfe-8ccd82e2447c tempest-GroupSnapshotsTest-846013661 None] Created volume successfully. Jul 14 13:00:28 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.66cb6fcb-8788-4222-933d-d20ad531a1ac" returned: 0 in 0.418s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16571c8d-c6f6-4aad-8100-c607fd48b305(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:00:28 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c9cc41-e21e-4d5b-a9d1-1627ef0a1cee]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:28 devstack sudo[93216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf Jul 14 13:00:28 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:28 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf" returned: 0 in 0.349s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16571c8d-c6f6-4aad-8100-c607fd48b305(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:00:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.66cb6fcb-8788-4222-933d-d20ad531a1ac {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:28 devstack sudo[93221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.66cb6fcb-8788-4222-933d-d20ad531a1ac Jul 14 13:00:28 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:29 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.66cb6fcb-8788-4222-933d-d20ad531a1ac" returned: 0 in 0.368s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.66cb6fcb-8788-4222-933d-d20ad531a1ac {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:29 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.66cb6fcb-8788-4222-933d-d20ad531a1ac Jul 14 13:00:29 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:29 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.66cb6fcb-8788-4222-933d-d20ad531a1ac" returned: 0 in 0.272s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-quobyte-66cb6fcb-8788-4222-933d-d20ad531a1ac" released by "_delete_snapshot" :: held 1.513s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-quobyte-16571c8d-c6f6-4aad-8100-c607fd48b305" released by "delete_snapshot" :: held 1.553s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] Created reservations ['8f62b501-aedc-4ba2-a0d8-0570b7f90c38', '447959ca-1e6b-45db-8775-f37b106f9c33', '53fabf47-42d0-4c22-8d35-8ad9ce4da2e5', '5d301b48-f634-4d82-b395-583b4f2caba0'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:00:29 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] Delete snapshot completed successfully. Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5551fee3-2d77-42da-a30a-b441cb848df0 tempest-SnapshotsActionsTest-507223422 None] Lock "cinder-66cb6fcb-8788-4222-933d-d20ad531a1ac-delete_snapshot" released by "delete_snapshot" :: held 1.714s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Flow 'volume_create_manager' (332dea50-c00d-48b7-9985-18c9ec1efcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45308c21-9542-4b88-aeda-bd801a2a9073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45308c21-9542-4b88-aeda-bd801a2a9073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1748198080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aea728aa-967a-4b4a-87e2-47d39ae380ea,host='devstack@QuobyteHD#QuobyteHD',id=5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ade236e81d44abca4bd35e961972d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:00:30Z,use_quota=True,user_id='3b0583a81d334ceea0343680506b84f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef8fbd45-f0f5-46f7-a2f5-156d2c421be2),volume_type_id=ef8fbd45-f0f5-46f7-a2f5-156d2c421be2)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3650fe-2fa5-4810-89b8-3f1529c85164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3650fe-2fa5-4810-89b8-3f1529c85164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b493731-32ff-4502-8f9f-4dfa2ffee3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b493731-32ff-4502-8f9f-4dfa2ffee3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7', 'volume_name': 'volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d819c81-e5b6-4519-8c7a-2d34f393ab93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d819c81-e5b6-4519-8c7a-2d34f393ab93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b278338c-46b7-4127-9820-6b8c9f462bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:29 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Volume 5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7', 'volume_size': 1} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aea728aa-967a-4b4a-87e2-47d39ae380ea,created_at=2026-07-14T11:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1748198080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aea728aa-967a-4b4a-87e2-47d39ae380ea,host='devstack@QuobyteHD#QuobyteHD',id=5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ade236e81d44abca4bd35e961972d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:00:30Z,use_quota=True,user_id='3b0583a81d334ceea0343680506b84f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef8fbd45-f0f5-46f7-a2f5-156d2c421be2),volume_type_id=ef8fbd45-f0f5-46f7-a2f5-156d2c421be2)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Creating volume 5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:00:29 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:00:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:29 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7 1073741824 Jul 14 13:00:29 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:30 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7 1073741824" returned: 0 in 0.457s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:30 devstack sudo[93235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7 Jul 14 13:00:30 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bdf2eabb-c24e-42fd-bd9e-fd2f9b3d7c19 tempest-SnapshotsActionsTest-1698140824 None] Acquiring lock "cinder-356a0f5a-d405-4886-84c5-eaa2e490cdbf-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bdf2eabb-c24e-42fd-bd9e-fd2f9b3d7c19 tempest-SnapshotsActionsTest-1698140824 None] Lock "cinder-356a0f5a-d405-4886-84c5-eaa2e490cdbf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bdf2eabb-c24e-42fd-bd9e-fd2f9b3d7c19 tempest-SnapshotsActionsTest-1698140824 None] Acquiring lock "cinder-quobyte-16571c8d-c6f6-4aad-8100-c607fd48b305" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bdf2eabb-c24e-42fd-bd9e-fd2f9b3d7c19 tempest-SnapshotsActionsTest-1698140824 None] Lock "cinder-quobyte-16571c8d-c6f6-4aad-8100-c607fd48b305" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bdf2eabb-c24e-42fd-bd9e-fd2f9b3d7c19 tempest-SnapshotsActionsTest-1698140824 None] Acquiring lock "cinder-quobyte-356a0f5a-d405-4886-84c5-eaa2e490cdbf" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bdf2eabb-c24e-42fd-bd9e-fd2f9b3d7c19 tempest-SnapshotsActionsTest-1698140824 None] Lock "cinder-quobyte-356a0f5a-d405-4886-84c5-eaa2e490cdbf" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-bdf2eabb-c24e-42fd-bd9e-fd2f9b3d7c19 tempest-SnapshotsActionsTest-1698140824 None] Deleting offline snapshot 356a0f5a-d405-4886-84c5-eaa2e490cdbf of volume 16571c8d-c6f6-4aad-8100-c607fd48b305 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-bdf2eabb-c24e-42fd-bd9e-fd2f9b3d7c19 tempest-SnapshotsActionsTest-1698140824 None] snapshot_file for this snap is: volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07e382b-08b5-400a-a88e-9a2654c45b6e]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bdf2eabb-c24e-42fd-bd9e-fd2f9b3d7c19 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:30 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf Jul 14 13:00:30 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:30 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7" returned: 0 in 0.262s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b278338c-46b7-4127-9820-6b8c9f462bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325400ef-bfff-4785-896c-6f28862f6795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:30 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Volume volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7 (5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7): created successfully Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325400ef-bfff-4785-896c-6f28862f6795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Flow 'volume_create_manager' (332dea50-c00d-48b7-9985-18c9ec1efcf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:00:30 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-fc9cee79-b140-4e62-830d-c44cc2ee7175 tempest-GroupSnapshotsTest-846013661 None] Created volume successfully. Jul 14 13:00:30 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bdf2eabb-c24e-42fd-bd9e-fd2f9b3d7c19 tempest-SnapshotsActionsTest-1698140824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf" returned: 0 in 0.358s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-bdf2eabb-c24e-42fd-bd9e-fd2f9b3d7c19 tempest-SnapshotsActionsTest-1698140824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16571c8d-c6f6-4aad-8100-c607fd48b305(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b1d308-517a-4229-a847-819e8b5dcb57]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bdf2eabb-c24e-42fd-bd9e-fd2f9b3d7c19 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:31 devstack sudo[93243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305 Jul 14 13:00:31 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:31 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-583af8f9-e833-4561-b3f4-72c2197ab37c tempest-GroupSnapshotsTest-846013661 None] Update group completed successfully. Jul 14 13:00:31 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bdf2eabb-c24e-42fd-bd9e-fd2f9b3d7c19 tempest-SnapshotsActionsTest-1698140824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305" returned: 0 in 0.369s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bdf2eabb-c24e-42fd-bd9e-fd2f9b3d7c19 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:31 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf Jul 14 13:00:31 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:31 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bdf2eabb-c24e-42fd-bd9e-fd2f9b3d7c19 tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf" returned: 0 in 0.336s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bdf2eabb-c24e-42fd-bd9e-fd2f9b3d7c19 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:31 devstack sudo[93254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf Jul 14 13:00:31 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:31 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bdf2eabb-c24e-42fd-bd9e-fd2f9b3d7c19 tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305.356a0f5a-d405-4886-84c5-eaa2e490cdbf" returned: 0 in 0.248s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bdf2eabb-c24e-42fd-bd9e-fd2f9b3d7c19 tempest-SnapshotsActionsTest-1698140824 None] Lock "cinder-quobyte-356a0f5a-d405-4886-84c5-eaa2e490cdbf" released by "_delete_snapshot" :: held 1.421s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bdf2eabb-c24e-42fd-bd9e-fd2f9b3d7c19 tempest-SnapshotsActionsTest-1698140824 None] Lock "cinder-quobyte-16571c8d-c6f6-4aad-8100-c607fd48b305" released by "delete_snapshot" :: held 1.447s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:32 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-bdf2eabb-c24e-42fd-bd9e-fd2f9b3d7c19 tempest-SnapshotsActionsTest-1698140824 None] Created reservations ['31fbe7d2-42f3-4ecc-a110-1f33dfa3a63c', '7b972a59-275e-4f6a-9d89-3032f5b9e223', 'e9248637-986c-4a93-913a-d472053911cf', 'bb7f272f-a37f-493b-867e-5bfdf7f32605'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:00:32 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-bdf2eabb-c24e-42fd-bd9e-fd2f9b3d7c19 tempest-SnapshotsActionsTest-1698140824 None] Delete snapshot completed successfully. Jul 14 13:00:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bdf2eabb-c24e-42fd-bd9e-fd2f9b3d7c19 tempest-SnapshotsActionsTest-1698140824 None] Lock "cinder-356a0f5a-d405-4886-84c5-eaa2e490cdbf-delete_snapshot" released by "delete_snapshot" :: held 1.596s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:32 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-21247c39-c918-4627-9e54-a17b75a717ba tempest-GroupSnapshotsTest-846013661 None] Update group completed successfully. Jul 14 13:00:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-24f5ba79-391d-4eb6-9cf8-5cb0cfae37e9 tempest-SnapshotsActionsTest-1698140824 None] Acquiring lock "cinder-16571c8d-c6f6-4aad-8100-c607fd48b305-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-24f5ba79-391d-4eb6-9cf8-5cb0cfae37e9 tempest-SnapshotsActionsTest-1698140824 None] Lock "cinder-16571c8d-c6f6-4aad-8100-c607fd48b305-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-24f5ba79-391d-4eb6-9cf8-5cb0cfae37e9 tempest-SnapshotsActionsTest-1698140824 None] Acquiring lock "cinder-quobyte-16571c8d-c6f6-4aad-8100-c607fd48b305" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-24f5ba79-391d-4eb6-9cf8-5cb0cfae37e9 tempest-SnapshotsActionsTest-1698140824 None] Lock "cinder-quobyte-16571c8d-c6f6-4aad-8100-c607fd48b305" acquired by "delete_volume" :: waited 0.014s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:32 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[a666405b-ddd4-44d7-9d3e-843e1800f0ef]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-24f5ba79-391d-4eb6-9cf8-5cb0cfae37e9 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:32 devstack sudo[93257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305 Jul 14 13:00:32 devstack sudo[93257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:33 devstack sudo[93257]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-24f5ba79-391d-4eb6-9cf8-5cb0cfae37e9 tempest-SnapshotsActionsTest-1698140824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305" returned: 0 in 0.372s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-24f5ba79-391d-4eb6-9cf8-5cb0cfae37e9 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:33 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305 Jul 14 13:00:33 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:33 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-24f5ba79-391d-4eb6-9cf8-5cb0cfae37e9 tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16571c8d-c6f6-4aad-8100-c607fd48b305" returned: 0 in 0.269s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-24f5ba79-391d-4eb6-9cf8-5cb0cfae37e9 tempest-SnapshotsActionsTest-1698140824 None] Lock "cinder-quobyte-16571c8d-c6f6-4aad-8100-c607fd48b305" released by "delete_volume" :: held 0.712s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:33 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-24f5ba79-391d-4eb6-9cf8-5cb0cfae37e9 tempest-SnapshotsActionsTest-1698140824 None] Created reservations ['c1638864-e027-49ca-955c-e9c04d51a678', '70ffd838-b3f5-492f-80fa-4bd5441670fb', '3735161e-b9e4-417d-af70-b28e6ad756f3', 'b1d2b550-c833-4cfb-aecf-850939edfd7f'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:00:33 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-d2054ca9-3732-4ce2-85d5-244743fd897d tempest-GroupSnapshotsTest-846013661 None] Update group completed successfully. Jul 14 13:00:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-24f5ba79-391d-4eb6-9cf8-5cb0cfae37e9 tempest-SnapshotsActionsTest-1698140824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-24f5ba79-391d-4eb6-9cf8-5cb0cfae37e9 tempest-SnapshotsActionsTest-1698140824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-24f5ba79-391d-4eb6-9cf8-5cb0cfae37e9 tempest-SnapshotsActionsTest-1698140824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:00:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-24f5ba79-391d-4eb6-9cf8-5cb0cfae37e9 tempest-SnapshotsActionsTest-1698140824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:00:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-24f5ba79-391d-4eb6-9cf8-5cb0cfae37e9 tempest-SnapshotsActionsTest-1698140824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-24f5ba79-391d-4eb6-9cf8-5cb0cfae37e9 tempest-SnapshotsActionsTest-1698140824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:33 devstack sudo[93266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:00:33 devstack sudo[93266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:33 devstack sudo[93266]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-24f5ba79-391d-4eb6-9cf8-5cb0cfae37e9 tempest-SnapshotsActionsTest-1698140824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.258s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:33 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-24f5ba79-391d-4eb6-9cf8-5cb0cfae37e9 tempest-SnapshotsActionsTest-1698140824 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:00:33 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-24f5ba79-391d-4eb6-9cf8-5cb0cfae37e9 tempest-SnapshotsActionsTest-1698140824 None] Deleted volume successfully. Jul 14 13:00:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-24f5ba79-391d-4eb6-9cf8-5cb0cfae37e9 tempest-SnapshotsActionsTest-1698140824 None] Lock "cinder-16571c8d-c6f6-4aad-8100-c607fd48b305-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:34 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-9a1a9061-e743-48ba-971c-4d71e057bea9 tempest-GroupSnapshotsTest-846013661 None] Update group completed successfully. Jul 14 13:00:36 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] GroupSnapshot f1c3adb7-691f-4cc9-a374-797a4b144b2b: creating. Jul 14 13:00:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] Group snapshot f1c3adb7-691f-4cc9-a374-797a4b144b2b: creating. {{(pid=86977) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 14 13:00:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] Creating offline snapshot 88802db7-2a39-4447-b700-542839a23948 of volume 5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:00:36 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd547a40-98f0-42b6-9bda-6c841b130a0f]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:36 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7 Jul 14 13:00:36 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:36 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7" returned: 0 in 0.403s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.88802db7-2a39-4447-b700-542839a23948 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:36 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.88802db7-2a39-4447-b700-542839a23948 1G Jul 14 13:00:36 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:37 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.88802db7-2a39-4447-b700-542839a23948 1G" returned: 0 in 0.444s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.88802db7-2a39-4447-b700-542839a23948 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:37 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.88802db7-2a39-4447-b700-542839a23948 Jul 14 13:00:37 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:37 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.88802db7-2a39-4447-b700-542839a23948" returned: 0 in 0.313s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:37 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.88802db7-2a39-4447-b700-542839a23948 is being set with open permissions: ugo+rw: NotImplementedError Jul 14 13:00:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.88802db7-2a39-4447-b700-542839a23948 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:37 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.88802db7-2a39-4447-b700-542839a23948 Jul 14 13:00:37 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:37 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.88802db7-2a39-4447-b700-542839a23948" returned: 0 in 0.264s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:37 devstack sudo[93292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.info Jul 14 13:00:37 devstack sudo[93292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:38 devstack sudo[93292]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.info" returned: 0 in 0.276s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:38 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 14 13:00:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:38 devstack sudo[93295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.info Jul 14 13:00:38 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:38 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.info" returned: 0 in 0.303s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.105s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] Creating offline snapshot aff94062-6a99-4b32-b05e-3eb34aa5d864 of volume b1ccccd0-c209-4904-9b52-3e073cf4373f {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:00:38 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[6935125a-5b1b-4942-9742-76fe7e36764c]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:38 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f Jul 14 13:00:38 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:38 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f" returned: 0 in 0.483s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.aff94062-6a99-4b32-b05e-3eb34aa5d864 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:39 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.aff94062-6a99-4b32-b05e-3eb34aa5d864 1G Jul 14 13:00:39 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-f5123009-dc52-49bc-8256-c53f42841d0b req-99f3b7bb-ff22-4281-a0cf-e551c5d1993f tempest-ServerActionsTestOtherA-1628124989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:39 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.aff94062-6a99-4b32-b05e-3eb34aa5d864 1G" returned: 0 in 0.510s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1ccccd0-c209-4904-9b52-3e073cf4373f -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.aff94062-6a99-4b32-b05e-3eb34aa5d864 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:39 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1ccccd0-c209-4904-9b52-3e073cf4373f -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.aff94062-6a99-4b32-b05e-3eb34aa5d864 Jul 14 13:00:39 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:39 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1ccccd0-c209-4904-9b52-3e073cf4373f -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.aff94062-6a99-4b32-b05e-3eb34aa5d864" returned: 0 in 0.347s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:39 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.aff94062-6a99-4b32-b05e-3eb34aa5d864 is being set with open permissions: ugo+rw: NotImplementedError Jul 14 13:00:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.aff94062-6a99-4b32-b05e-3eb34aa5d864 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:39 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.aff94062-6a99-4b32-b05e-3eb34aa5d864 Jul 14 13:00:39 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:40 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.aff94062-6a99-4b32-b05e-3eb34aa5d864" returned: 0 in 0.308s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:40 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:00:40 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.info Jul 14 13:00:40 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Flow 'volume_create_manager' (197ffac0-6726-4b91-857e-fc920c03b4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:00:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a20c20e-e07c-4e49-b301-d72269f4cc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a20c20e-e07c-4e49-b301-d72269f4cc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-894038020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64442ee3-d4db-4959-b6f5-470f1d189f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a776181d6140d6883ac80cb97795ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:00:40Z,use_quota=True,user_id='be67f5f61375488fa2a986d7c99e25bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92dcb84-ebb6-48bd-860c-8290fd17835b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92dcb84-ebb6-48bd-860c-8290fd17835b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3255ebea-bd59-446e-8423-c3bf1734df29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3255ebea-bd59-446e-8423-c3bf1734df29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64442ee3-d4db-4959-b6f5-470f1d189f7d', 'volume_name': 'volume-64442ee3-d4db-4959-b6f5-470f1d189f7d', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b705c1e6-598f-445d-be00-6daf262157cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b705c1e6-598f-445d-be00-6daf262157cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (739aa8e7-0723-4d84-bc97-222b2b85572d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:40 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Volume 64442ee3-d4db-4959-b6f5-470f1d189f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64442ee3-d4db-4959-b6f5-470f1d189f7d', 'volume_size': 1} Jul 14 13:00:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:40 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.info" returned: 0 in 0.286s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:40 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 14 13:00:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:40 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.info Jul 14 13:00:40 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:40 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.info" returned: 0 in 0.273s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.347s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-f5123009-dc52-49bc-8256-c53f42841d0b req-99f3b7bb-ff22-4281-a0cf-e551c5d1993f tempest-ServerActionsTestOtherA-1628124989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.609s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:40 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fb628d-5c20-4bdb-b52c-14a9433e9630]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-f5123009-dc52-49bc-8256-c53f42841d0b req-99f3b7bb-ff22-4281-a0cf-e551c5d1993f tempest-ServerActionsTestOtherA-1628124989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:40 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-d92899f5-96b1-43f0-9a9b-eb0c2c88ac01 tempest-GroupSnapshotsTest-846013661 None] group_snapshot f1c3adb7-691f-4cc9-a374-797a4b144b2b: created successfully Jul 14 13:00:40 devstack sudo[93339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570 Jul 14 13:00:40 devstack sudo[93339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:41 devstack sudo[93339]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-f5123009-dc52-49bc-8256-c53f42841d0b req-99f3b7bb-ff22-4281-a0cf-e551c5d1993f tempest-ServerActionsTestOtherA-1628124989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570" returned: 0 in 0.410s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-f5123009-dc52-49bc-8256-c53f42841d0b req-99f3b7bb-ff22-4281-a0cf-e551c5d1993f tempest-ServerActionsTestOtherA-1628124989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.428s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.912s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-894038020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64442ee3-d4db-4959-b6f5-470f1d189f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a776181d6140d6883ac80cb97795ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:00:40Z,use_quota=True,user_id='be67f5f61375488fa2a986d7c99e25bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:00:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Creating volume 64442ee3-d4db-4959-b6f5-470f1d189f7d {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:00:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:00:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:00:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:00:41 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:00:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-64442ee3-d4db-4959-b6f5-470f1d189f7d 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:41 devstack sudo[93345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-64442ee3-d4db-4959-b6f5-470f1d189f7d 1073741824 Jul 14 13:00:41 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-f5123009-dc52-49bc-8256-c53f42841d0b req-99f3b7bb-ff22-4281-a0cf-e551c5d1993f tempest-ServerActionsTestOtherA-1628124989 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1', 'name': 'volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24cd30fc-d5a0-4918-813d-57792f5e044f', 'enforce_multipath': True} {{(pid=86977) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 13:00:41 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-f5123009-dc52-49bc-8256-c53f42841d0b req-99f3b7bb-ff22-4281-a0cf-e551c5d1993f tempest-ServerActionsTestOtherA-1628124989 None] attachment_update completed successfully. Jul 14 13:00:41 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] group_snapshot f1c3adb7-691f-4cc9-a374-797a4b144b2b: deleting Jul 14 13:00:41 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-64442ee3-d4db-4959-b6f5-470f1d189f7d 1073741824" returned: 0 in 0.556s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] group_snapshot f1c3adb7-691f-4cc9-a374-797a4b144b2b: deleting {{(pid=86977) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 14 13:00:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-64442ee3-d4db-4959-b6f5-470f1d189f7d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:41 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "cinder-quobyte-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:41 devstack sudo[93733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-64442ee3-d4db-4959-b6f5-470f1d189f7d Jul 14 13:00:41 devstack sudo[93733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:41 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:41 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "cinder-quobyte-88802db7-2a39-4447-b700-542839a23948" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:41 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-88802db7-2a39-4447-b700-542839a23948" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Deleting offline snapshot 88802db7-2a39-4447-b700-542839a23948 of volume 5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:00:42 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] snapshot_file for this snap is: volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.88802db7-2a39-4447-b700-542839a23948 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:00:42 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75e7ec6-c1b8-4ba8-be94-7414bbbde413]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.88802db7-2a39-4447-b700-542839a23948 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:42 devstack sudo[93733]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-64442ee3-d4db-4959-b6f5-470f1d189f7d" returned: 0 in 0.391s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:42 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:00:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (739aa8e7-0723-4d84-bc97-222b2b85572d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64442ee3-d4db-4959-b6f5-470f1d189f7d', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5fa97b-305d-47bf-a4a7-aaa70eddf82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:42 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Volume volume-64442ee3-d4db-4959-b6f5-470f1d189f7d (64442ee3-d4db-4959-b6f5-470f1d189f7d): created successfully Jul 14 13:00:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5fa97b-305d-47bf-a4a7-aaa70eddf82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Flow 'volume_create_manager' (197ffac0-6726-4b91-857e-fc920c03b4e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:00:42 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.88802db7-2a39-4447-b700-542839a23948 Jul 14 13:00:42 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:42 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-1f43cfe2-1a3e-49d9-86a2-ed40e95edd39 tempest-AttachVolumeNegativeTest-115818279 None] Created volume successfully. Jul 14 13:00:42 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.88802db7-2a39-4447-b700-542839a23948" returned: 0 in 0.582s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:42 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:00:42 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[988e8ed7-e0aa-4be3-aeb0-0e33fc186f3a]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:42 devstack sudo[93741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7 Jul 14 13:00:42 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:43 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7" returned: 0 in 0.384s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.88802db7-2a39-4447-b700-542839a23948 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:43 devstack sudo[93746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.88802db7-2a39-4447-b700-542839a23948 Jul 14 13:00:43 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:43 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.88802db7-2a39-4447-b700-542839a23948" returned: 0 in 0.376s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.88802db7-2a39-4447-b700-542839a23948 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:43 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.88802db7-2a39-4447-b700-542839a23948 Jul 14 13:00:43 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:43 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7.88802db7-2a39-4447-b700-542839a23948" returned: 0 in 0.322s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-88802db7-2a39-4447-b700-542839a23948" released by "_delete_snapshot" :: held 1.820s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7" released by "delete_snapshot" :: held 1.890s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "cinder-quobyte-b1ccccd0-c209-4904-9b52-3e073cf4373f" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-b1ccccd0-c209-4904-9b52-3e073cf4373f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "cinder-quobyte-aff94062-6a99-4b32-b05e-3eb34aa5d864" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-aff94062-6a99-4b32-b05e-3eb34aa5d864" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:43 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Deleting offline snapshot aff94062-6a99-4b32-b05e-3eb34aa5d864 of volume b1ccccd0-c209-4904-9b52-3e073cf4373f {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:00:43 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] snapshot_file for this snap is: volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.aff94062-6a99-4b32-b05e-3eb34aa5d864 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:00:43 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe4a730-d0e9-4665-ad4c-d4a96993bf6b]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.aff94062-6a99-4b32-b05e-3eb34aa5d864 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:44 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.aff94062-6a99-4b32-b05e-3eb34aa5d864 Jul 14 13:00:44 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:44 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.aff94062-6a99-4b32-b05e-3eb34aa5d864" returned: 0 in 0.514s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:44 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1ccccd0-c209-4904-9b52-3e073cf4373f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:00:44 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[798c222a-287b-40ea-8cb3-167ac522a6ca]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-26b131c9-d6e0-42a6-951d-fca1f08d173a req-929bac3e-c295-4d2b-90c1-39273943e820 tempest-AttachVolumeNegativeTest-115818279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-26b131c9-d6e0-42a6-951d-fca1f08d173a req-929bac3e-c295-4d2b-90c1-39273943e820 tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:44 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[649867a2-247d-43f2-bd2d-3f49a6d60b9c]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-26b131c9-d6e0-42a6-951d-fca1f08d173a req-929bac3e-c295-4d2b-90c1-39273943e820 tempest-AttachVolumeNegativeTest-115818279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-64442ee3-d4db-4959-b6f5-470f1d189f7d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:44 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f Jul 14 13:00:44 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:44 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-64442ee3-d4db-4959-b6f5-470f1d189f7d Jul 14 13:00:44 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:45 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f" returned: 0 in 0.575s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.aff94062-6a99-4b32-b05e-3eb34aa5d864 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:45 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-26b131c9-d6e0-42a6-951d-fca1f08d173a req-929bac3e-c295-4d2b-90c1-39273943e820 tempest-AttachVolumeNegativeTest-115818279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-64442ee3-d4db-4959-b6f5-470f1d189f7d" returned: 0 in 0.534s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-26b131c9-d6e0-42a6-951d-fca1f08d173a req-929bac3e-c295-4d2b-90c1-39273943e820 tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.563s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:45 devstack sudo[93788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.aff94062-6a99-4b32-b05e-3eb34aa5d864 Jul 14 13:00:45 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-26b131c9-d6e0-42a6-951d-fca1f08d173a req-929bac3e-c295-4d2b-90c1-39273943e820 tempest-AttachVolumeNegativeTest-115818279 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1', 'name': 'volume-64442ee3-d4db-4959-b6f5-470f1d189f7d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc29ac48-a3e9-48b3-b79b-f9cf61148b56', 'enforce_multipath': True} {{(pid=86977) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 13:00:45 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-26b131c9-d6e0-42a6-951d-fca1f08d173a req-929bac3e-c295-4d2b-90c1-39273943e820 tempest-AttachVolumeNegativeTest-115818279 None] attachment_update completed successfully. Jul 14 13:00:45 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.aff94062-6a99-4b32-b05e-3eb34aa5d864" returned: 0 in 0.475s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.aff94062-6a99-4b32-b05e-3eb34aa5d864 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:45 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.aff94062-6a99-4b32-b05e-3eb34aa5d864 Jul 14 13:00:45 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:45 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-75df7f14-a989-4901-930c-2d0af99df661 req-1c74e9a8-861f-4857-ae79-b6d8d32548c9 tempest-ServerActionsTestOtherA-1628124989 None] Terminate volume connection completed successfully. Jul 14 13:00:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-75df7f14-a989-4901-930c-2d0af99df661 req-1c74e9a8-861f-4857-ae79-b6d8d32548c9 tempest-ServerActionsTestOtherA-1628124989 None] Deleting attachment 24cd30fc-d5a0-4918-813d-57792f5e044f. {{(pid=86977) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 13:00:45 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f.aff94062-6a99-4b32-b05e-3eb34aa5d864" returned: 0 in 0.322s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-aff94062-6a99-4b32-b05e-3eb34aa5d864" released by "_delete_snapshot" :: held 2.055s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-b1ccccd0-c209-4904-9b52-3e073cf4373f" released by "delete_snapshot" :: held 2.095s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:46 devstack cinder-volume[86977]: WARNING cinder.quota [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-82734342 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-82734342, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:00:46 devstack cinder-volume[86977]: WARNING cinder.quota [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-82734342 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-82734342, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:00:46 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Created reservations ['fd285b80-fa25-4a88-a816-dfb5acb272c1', 'aa358b74-6eba-451d-931d-dc2f1c551e4c', '2ba0dbd3-7c50-4cb5-a43c-b2b7ca497cf9', '548efc99-cebc-47c7-9996-e714befa567a'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:00:46 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] Created reservations ['4911b362-7235-4899-b2f9-1307c871aa4c', '538e7a43-bf64-498f-ad93-e7cf56f1d15f', 'acfac0d9-050a-4389-84d6-b08ec072500e', '0c2acab0-e103-475a-84e9-1c5f83070250'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:00:46 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-42e7b967-c1dd-4eda-9fcf-cf9732bf2178 tempest-GroupSnapshotsTest-846013661 None] group_snapshot f1c3adb7-691f-4cc9-a374-797a4b144b2b: deleted successfully Jul 14 13:00:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-75df7f14-a989-4901-930c-2d0af99df661 req-2d4dc6b2-ae44-43ad-84bd-67f0c42a8cf3 tempest-ServerActionsTestOtherA-1628124989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-75df7f14-a989-4901-930c-2d0af99df661 req-2d4dc6b2-ae44-43ad-84bd-67f0c42a8cf3 tempest-ServerActionsTestOtherA-1628124989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:47 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e4dc27-0858-4352-95ff-00b2b7fadba0]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-75df7f14-a989-4901-930c-2d0af99df661 req-2d4dc6b2-ae44-43ad-84bd-67f0c42a8cf3 tempest-ServerActionsTestOtherA-1628124989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "cinder-quobyte-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7" acquired by "delete_volume" :: waited 0.038s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:47 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570 Jul 14 13:00:47 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:47 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91e5ec7-5866-48e2-83b9-ee884a8cdc89]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:47 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7 Jul 14 13:00:47 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:47 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-75df7f14-a989-4901-930c-2d0af99df661 req-2d4dc6b2-ae44-43ad-84bd-67f0c42a8cf3 tempest-ServerActionsTestOtherA-1628124989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570" returned: 0 in 0.631s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-75df7f14-a989-4901-930c-2d0af99df661 req-2d4dc6b2-ae44-43ad-84bd-67f0c42a8cf3 tempest-ServerActionsTestOtherA-1628124989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.720s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:47 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-75df7f14-a989-4901-930c-2d0af99df661 req-2d4dc6b2-ae44-43ad-84bd-67f0c42a8cf3 tempest-ServerActionsTestOtherA-1628124989 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1', 'name': 'volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a3bbf2e-f1fb-4ca3-9289-2258785b1d21', 'enforce_multipath': True} {{(pid=86977) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 13:00:47 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7" returned: 0 in 0.525s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:47 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-75df7f14-a989-4901-930c-2d0af99df661 req-2d4dc6b2-ae44-43ad-84bd-67f0c42a8cf3 tempest-ServerActionsTestOtherA-1628124989 None] attachment_update completed successfully. Jul 14 13:00:47 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7 Jul 14 13:00:47 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:48 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7" returned: 0 in 0.308s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:48 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-5a10d5bd-cc00-44f7-af49-7ef3a7a50bb7" released by "delete_volume" :: held 0.950s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:48 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "cinder-quobyte-b1ccccd0-c209-4904-9b52-3e073cf4373f" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:48 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-b1ccccd0-c209-4904-9b52-3e073cf4373f" acquired by "delete_volume" :: waited 0.028s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:48 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[948bcde2-39dd-4897-8886-0ed2a9e5a5b7]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:48 devstack sudo[93850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f Jul 14 13:00:48 devstack sudo[93850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:48 devstack sudo[93850]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f" returned: 0 in 0.543s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:48 devstack sudo[93866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f Jul 14 13:00:48 devstack sudo[93866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b1ccccd0-c209-4904-9b52-3e073cf4373f" returned: 0 in 0.370s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:49 devstack sudo[93866]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:49 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-b1ccccd0-c209-4904-9b52-3e073cf4373f" released by "delete_volume" :: held 1.006s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:00:49 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] Created reservations ['889efd52-a661-46d8-a5cf-8f666d482928'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:00:49 devstack cinder-volume[86977]: WARNING cinder.quota [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-82734342 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-82734342, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:00:49 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] Created reservations ['ec3c2dba-fbed-4b32-89ba-2aeb98abc92b', 'a1a65c80-5b9c-4274-ba53-274650b7197e', 'eba3da6f-83cc-4172-a766-87ac1ff10985', 'cb0e2b16-696a-4979-a65a-018c6669d77a'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:00:49 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] Created reservations ['8bc5249c-987c-406c-96d3-770979a2df22', '05ce3469-3b1a-436d-9170-28fcb7dce49a', 'ecc63c03-7a42-4583-837b-dcdfd29cfb26', '378a85da-5bab-4853-917b-d54e7533b86a'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:00:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:00:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:00:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:50 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:00:50 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:50 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.372s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:50 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:00:50 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c014e6ce-0447-466d-b5f2-159b03e1fce6 tempest-GroupSnapshotsTest-846013661 None] Delete group completed successfully. Jul 14 13:00:51 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-5f839a9f-1edc-4b03-82bd-319c7ddd52e4 tempest-GroupSnapshotsTest-846013661 None] Group tempest-GroupSnapshotsTest-Group-1596741064: creating Jul 14 13:00:52 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-5f839a9f-1edc-4b03-82bd-319c7ddd52e4 tempest-GroupSnapshotsTest-846013661 None] Group tempest-GroupSnapshotsTest-Group-1596741064: created successfully Jul 14 13:00:52 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-5f839a9f-1edc-4b03-82bd-319c7ddd52e4 tempest-GroupSnapshotsTest-846013661 None] Create group completed successfully. Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=138,cinder:INSERT=33,cinder:UPDATE=125,cinder:DELETE=6 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:UPDATE=134,cinder:SELECT=154,cinder:INSERT=30,cinder:DELETE=4 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Flow 'volume_create_manager' (2adbddb3-1c48-41f3-96ae-ba2d9653862f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5855de8e-366d-4aee-b17c-7f8752facb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5855de8e-366d-4aee-b17c-7f8752facb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-913376996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=12ca608e-6058-4930-82c7-7d88849684b9,host='devstack@QuobyteHD#QuobyteHD',id=75d785ec-f82b-4586-892d-6c85513656e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ade236e81d44abca4bd35e961972d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:00:54Z,use_quota=True,user_id='3b0583a81d334ceea0343680506b84f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1530c3f-74e0-4bd5-a6e3-1638fd12e040),volume_type_id=a1530c3f-74e0-4bd5-a6e3-1638fd12e040)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (566d7590-b8c9-4c7e-8f8a-e1cf01a95e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (566d7590-b8c9-4c7e-8f8a-e1cf01a95e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (756eeb31-baa8-4b19-8a2c-a7109e276778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (756eeb31-baa8-4b19-8a2c-a7109e276778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d785ec-f82b-4586-892d-6c85513656e2', 'volume_name': 'volume-75d785ec-f82b-4586-892d-6c85513656e2', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (431e6c05-d7cf-4f14-9f16-29a9a009a821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (431e6c05-d7cf-4f14-9f16-29a9a009a821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5daed98a-84d9-43f0-93c5-e8183e380e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:54 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Volume 75d785ec-f82b-4586-892d-6c85513656e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d785ec-f82b-4586-892d-6c85513656e2', 'volume_size': 1} Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=12ca608e-6058-4930-82c7-7d88849684b9,created_at=2026-07-14T11:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-913376996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=12ca608e-6058-4930-82c7-7d88849684b9,host='devstack@QuobyteHD#QuobyteHD',id=75d785ec-f82b-4586-892d-6c85513656e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ade236e81d44abca4bd35e961972d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:00:54Z,use_quota=True,user_id='3b0583a81d334ceea0343680506b84f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1530c3f-74e0-4bd5-a6e3-1638fd12e040),volume_type_id=a1530c3f-74e0-4bd5-a6e3-1638fd12e040)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Creating volume 75d785ec-f82b-4586-892d-6c85513656e2 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:00:54 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:00:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:54 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2 1073741824 Jul 14 13:00:54 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:55 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2 1073741824" returned: 0 in 0.661s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:55 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2 Jul 14 13:00:55 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:55 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2" returned: 0 in 0.357s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:00:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5daed98a-84d9-43f0-93c5-e8183e380e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d785ec-f82b-4586-892d-6c85513656e2', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49387449-8152-454f-a4db-3c70e16d2781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:55 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Volume volume-75d785ec-f82b-4586-892d-6c85513656e2 (75d785ec-f82b-4586-892d-6c85513656e2): created successfully Jul 14 13:00:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49387449-8152-454f-a4db-3c70e16d2781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Flow 'volume_create_manager' (2adbddb3-1c48-41f3-96ae-ba2d9653862f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:00:55 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b19015c1-5c75-40c4-a4a3-641ad04b45ad tempest-GroupSnapshotsTest-846013661 None] Created volume successfully. Jul 14 13:00:56 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:00:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Flow 'volume_create_manager' (185b8d90-f658-443d-8ab9-242a27f101f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:00:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eb925ac-3b83-44cc-ba7c-b58f257751d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eb925ac-3b83-44cc-ba7c-b58f257751d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1525548781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='255148db248d467f914ad898a3031795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:00:56Z,use_quota=True,user_id='da7fd404bb964644966fab8f23157b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaad8741-cb35-42d3-a7f9-b931377b0c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaad8741-cb35-42d3-a7f9-b931377b0c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afde4cff-0068-4607-8d32-40f6965007a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afde4cff-0068-4607-8d32-40f6965007a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc', 'volume_name': 'volume-74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb493f6-5c55-410f-a43a-0281ed8025cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb493f6-5c55-410f-a43a-0281ed8025cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcdab1d8-b75e-4b89-8bf0-6763a7cabfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:56 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Volume 74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc', 'volume_size': 1} Jul 14 13:00:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1525548781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='255148db248d467f914ad898a3031795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:00:56Z,use_quota=True,user_id='da7fd404bb964644966fab8f23157b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:00:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Creating volume 74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:00:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:00:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:00:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:00:56 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:00:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:56 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc 1073741824 Jul 14 13:00:56 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:57 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc 1073741824" returned: 0 in 0.884s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:57 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc Jul 14 13:00:57 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:57 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc" returned: 0 in 0.508s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:00:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:00:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcdab1d8-b75e-4b89-8bf0-6763a7cabfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (587938d3-c725-4c9a-9944-72fcbd183042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:00:58 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-65a32b55-e608-4af1-8803-6b78a2f5871f tempest-GroupSnapshotsTest-846013661 None] GroupSnapshot fa90a6c5-1f5d-4fc5-8066-189878495994: creating. Jul 14 13:00:58 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Volume volume-74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc (74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc): created successfully Jul 14 13:00:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (587938d3-c725-4c9a-9944-72fcbd183042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:00:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Flow 'volume_create_manager' (185b8d90-f658-443d-8ab9-242a27f101f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:00:58 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-8cd72aa9-498f-48d5-8739-b1f717e73e3f tempest-VolumeQuotasAdminTestJSON-1994580201 None] Created volume successfully. Jul 14 13:00:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-65a32b55-e608-4af1-8803-6b78a2f5871f tempest-GroupSnapshotsTest-846013661 None] Group snapshot fa90a6c5-1f5d-4fc5-8066-189878495994: creating. {{(pid=86977) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 14 13:00:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-65a32b55-e608-4af1-8803-6b78a2f5871f tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:00:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-65a32b55-e608-4af1-8803-6b78a2f5871f tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:00:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-65a32b55-e608-4af1-8803-6b78a2f5871f tempest-GroupSnapshotsTest-846013661 None] Creating offline snapshot f86c0a62-6ec9-4584-b4d8-439d96c82d47 of volume 75d785ec-f82b-4586-892d-6c85513656e2 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:00:58 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[8661a563-79ff-4e31-8164-beb5b0954fe2]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-65a32b55-e608-4af1-8803-6b78a2f5871f tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:58 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2 Jul 14 13:00:58 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:58 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-28f28885-47d5-48f2-bfa2-a399788b9fa1 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Acquiring lock "cinder-74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-65a32b55-e608-4af1-8803-6b78a2f5871f tempest-GroupSnapshotsTest-846013661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2" returned: 0 in 0.615s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-65a32b55-e608-4af1-8803-6b78a2f5871f tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.f86c0a62-6ec9-4584-b4d8-439d96c82d47 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-28f28885-47d5-48f2-bfa2-a399788b9fa1 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Lock "cinder-74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:58 devstack sudo[94059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.f86c0a62-6ec9-4584-b4d8-439d96c82d47 1G Jul 14 13:00:58 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:59 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-28f28885-47d5-48f2-bfa2-a399788b9fa1 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Acquiring lock "cinder-quobyte-74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:00:59 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-28f28885-47d5-48f2-bfa2-a399788b9fa1 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Lock "cinder-quobyte-74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc" acquired by "delete_volume" :: waited 0.027s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:00:59 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaf3bb1-a603-4eb9-b7c6-311c055a4c92]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:00:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-28f28885-47d5-48f2-bfa2-a399788b9fa1 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:59 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc Jul 14 13:00:59 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:59 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-65a32b55-e608-4af1-8803-6b78a2f5871f tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.f86c0a62-6ec9-4584-b4d8-439d96c82d47 1G" returned: 0 in 0.591s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-65a32b55-e608-4af1-8803-6b78a2f5871f tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d785ec-f82b-4586-892d-6c85513656e2 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.f86c0a62-6ec9-4584-b4d8-439d96c82d47 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:59 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d785ec-f82b-4586-892d-6c85513656e2 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.f86c0a62-6ec9-4584-b4d8-439d96c82d47 Jul 14 13:00:59 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:00:59 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Jul 14 13:00:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-28f28885-47d5-48f2-bfa2-a399788b9fa1 tempest-VolumeQuotasAdminTestJSON-1994580201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc" returned: 0 in 0.706s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:00:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-28f28885-47d5-48f2-bfa2-a399788b9fa1 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:00:59 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc Jul 14 13:00:59 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:00 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:00 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-65a32b55-e608-4af1-8803-6b78a2f5871f tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d785ec-f82b-4586-892d-6c85513656e2 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.f86c0a62-6ec9-4584-b4d8-439d96c82d47" returned: 0 in 0.798s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:00 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-65a32b55-e608-4af1-8803-6b78a2f5871f tempest-GroupSnapshotsTest-846013661 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.f86c0a62-6ec9-4584-b4d8-439d96c82d47 is being set with open permissions: ugo+rw: NotImplementedError Jul 14 13:01:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-65a32b55-e608-4af1-8803-6b78a2f5871f tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.f86c0a62-6ec9-4584-b4d8-439d96c82d47 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-28f28885-47d5-48f2-bfa2-a399788b9fa1 tempest-VolumeQuotasAdminTestJSON-1994580201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc" returned: 0 in 0.540s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:00 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.f86c0a62-6ec9-4584-b4d8-439d96c82d47 Jul 14 13:01:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-28f28885-47d5-48f2-bfa2-a399788b9fa1 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Lock "cinder-quobyte-74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc" released by "delete_volume" :: held 1.320s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:01:00 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:00 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-28f28885-47d5-48f2-bfa2-a399788b9fa1 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Created reservations ['8c85c0c0-4897-4873-bb7d-f70420eac29a', '4c15cd4c-b196-4834-96c2-ffe50f1e7b90', '8c008888-28ba-4ea9-9bf9-03ed107c17d6', '50c47768-780d-4a0f-93cc-a46ccd50fbcd'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:01:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-28f28885-47d5-48f2-bfa2-a399788b9fa1 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:01:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-28f28885-47d5-48f2-bfa2-a399788b9fa1 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:01:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-28f28885-47d5-48f2-bfa2-a399788b9fa1 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:01:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-28f28885-47d5-48f2-bfa2-a399788b9fa1 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:01:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-28f28885-47d5-48f2-bfa2-a399788b9fa1 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:01:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-28f28885-47d5-48f2-bfa2-a399788b9fa1 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:00 devstack sudo[94082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:01:00 devstack sudo[94082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:00 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-65a32b55-e608-4af1-8803-6b78a2f5871f tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.f86c0a62-6ec9-4584-b4d8-439d96c82d47" returned: 0 in 0.390s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-65a32b55-e608-4af1-8803-6b78a2f5871f tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:00 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.info Jul 14 13:01:00 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:00 devstack sudo[94082]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-28f28885-47d5-48f2-bfa2-a399788b9fa1 tempest-VolumeQuotasAdminTestJSON-1994580201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.287s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:00 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-28f28885-47d5-48f2-bfa2-a399788b9fa1 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:01:00 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-28f28885-47d5-48f2-bfa2-a399788b9fa1 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Deleted volume successfully. Jul 14 13:01:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-28f28885-47d5-48f2-bfa2-a399788b9fa1 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Lock "cinder-74006f3a-ff89-40b0-ab1e-c0a9c9a4c9bc-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:01:01 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-65a32b55-e608-4af1-8803-6b78a2f5871f tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.info" returned: 0 in 0.283s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:01 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-65a32b55-e608-4af1-8803-6b78a2f5871f tempest-GroupSnapshotsTest-846013661 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 14 13:01:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-65a32b55-e608-4af1-8803-6b78a2f5871f tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:01 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.info Jul 14 13:01:01 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-65a32b55-e608-4af1-8803-6b78a2f5871f tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.info" returned: 0 in 0.342s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:01 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-65a32b55-e608-4af1-8803-6b78a2f5871f tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.253s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:01:01 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-65a32b55-e608-4af1-8803-6b78a2f5871f tempest-GroupSnapshotsTest-846013661 None] group_snapshot fa90a6c5-1f5d-4fc5-8066-189878495994: created successfully Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Flow 'volume_create_manager' (39d6bbe3-81c8-4c64-95d7-db2d778833b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a34693-74d5-41b5-b5ce-8bac9f192270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a34693-74d5-41b5-b5ce-8bac9f192270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1194504389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4428d374-f1d6-4d5a-b96b-b31dec1d8e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='255148db248d467f914ad898a3031795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:01:02Z,use_quota=True,user_id='da7fd404bb964644966fab8f23157b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3c340c-75e1-4e14-88e4-a6d1a33b803f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3c340c-75e1-4e14-88e4-a6d1a33b803f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e5efad-1b47-4297-b0f2-4960105f9338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e5efad-1b47-4297-b0f2-4960105f9338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4428d374-f1d6-4d5a-b96b-b31dec1d8e8c', 'volume_name': 'volume-4428d374-f1d6-4d5a-b96b-b31dec1d8e8c', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f460466-fb69-43a9-bf7b-bdbdad30fd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f460466-fb69-43a9-bf7b-bdbdad30fd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3882c3-a6ea-490f-999e-b143ba83d960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:02 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Volume 4428d374-f1d6-4d5a-b96b-b31dec1d8e8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4428d374-f1d6-4d5a-b96b-b31dec1d8e8c', 'volume_size': 1} Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1194504389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4428d374-f1d6-4d5a-b96b-b31dec1d8e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='255148db248d467f914ad898a3031795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:01:02Z,use_quota=True,user_id='da7fd404bb964644966fab8f23157b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Creating volume 4428d374-f1d6-4d5a-b96b-b31dec1d8e8c {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:01:02 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4428d374-f1d6-4d5a-b96b-b31dec1d8e8c 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:02 devstack sudo[94116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4428d374-f1d6-4d5a-b96b-b31dec1d8e8c 1073741824 Jul 14 13:01:02 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:02 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] group_snapshot fa90a6c5-1f5d-4fc5-8066-189878495994: deleting Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] group_snapshot fa90a6c5-1f5d-4fc5-8066-189878495994: deleting {{(pid=86977) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 14 13:01:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "cinder-quobyte-75d785ec-f82b-4586-892d-6c85513656e2" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:01:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-75d785ec-f82b-4586-892d-6c85513656e2" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:01:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "cinder-quobyte-f86c0a62-6ec9-4584-b4d8-439d96c82d47" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:01:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-f86c0a62-6ec9-4584-b4d8-439d96c82d47" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:01:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] Deleting offline snapshot f86c0a62-6ec9-4584-b4d8-439d96c82d47 of volume 75d785ec-f82b-4586-892d-6c85513656e2 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:01:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] snapshot_file for this snap is: volume-75d785ec-f82b-4586-892d-6c85513656e2.f86c0a62-6ec9-4584-b4d8-439d96c82d47 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:01:03 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5196dc6-4021-44cb-b28c-ee8afcdb7c35]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:01:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.f86c0a62-6ec9-4584-b4d8-439d96c82d47 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:03 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.f86c0a62-6ec9-4584-b4d8-439d96c82d47 Jul 14 13:01:03 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:03 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4428d374-f1d6-4d5a-b96b-b31dec1d8e8c 1073741824" returned: 0 in 1.108s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4428d374-f1d6-4d5a-b96b-b31dec1d8e8c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:03 devstack sudo[94127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4428d374-f1d6-4d5a-b96b-b31dec1d8e8c Jul 14 13:01:03 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:03 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.f86c0a62-6ec9-4584-b4d8-439d96c82d47" returned: 0 in 0.531s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75d785ec-f82b-4586-892d-6c85513656e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:01:03 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ebede2-72b5-4903-b0cc-39298afbd737]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:01:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:03 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2 Jul 14 13:01:03 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:03 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4428d374-f1d6-4d5a-b96b-b31dec1d8e8c" returned: 0 in 0.416s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:01:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:01:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3882c3-a6ea-490f-999e-b143ba83d960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4428d374-f1d6-4d5a-b96b-b31dec1d8e8c', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9974a3c8-b3ce-4204-a0f7-c28ec77f3f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:04 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Volume volume-4428d374-f1d6-4d5a-b96b-b31dec1d8e8c (4428d374-f1d6-4d5a-b96b-b31dec1d8e8c): created successfully Jul 14 13:01:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9974a3c8-b3ce-4204-a0f7-c28ec77f3f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Flow 'volume_create_manager' (39d6bbe3-81c8-4c64-95d7-db2d778833b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:01:04 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-bc12af9b-d7d2-4108-8cc8-c640655b9f94 tempest-VolumeQuotasAdminTestJSON-1994580201 None] Created volume successfully. Jul 14 13:01:04 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2" returned: 0 in 0.720s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.f86c0a62-6ec9-4584-b4d8-439d96c82d47 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:04 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.f86c0a62-6ec9-4584-b4d8-439d96c82d47 Jul 14 13:01:04 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:04 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.f86c0a62-6ec9-4584-b4d8-439d96c82d47" returned: 0 in 0.511s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.f86c0a62-6ec9-4584-b4d8-439d96c82d47 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:04 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.f86c0a62-6ec9-4584-b4d8-439d96c82d47 Jul 14 13:01:04 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:05 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2.f86c0a62-6ec9-4584-b4d8-439d96c82d47" returned: 0 in 0.308s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:05 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-f86c0a62-6ec9-4584-b4d8-439d96c82d47" released by "_delete_snapshot" :: held 2.258s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:01:05 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-697897a5-15f4-41c4-ba71-bd7f503fdb19 tempest-VolumeQuotasAdminTestJSON-515999435 None] Transfer volume completed successfully. Jul 14 13:01:05 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-75d785ec-f82b-4586-892d-6c85513656e2" released by "delete_snapshot" :: held 2.306s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:01:05 devstack cinder-volume[86977]: WARNING cinder.quota [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1992106726 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1992106726, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:01:05 devstack cinder-volume[86977]: WARNING cinder.quota [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1992106726 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1992106726, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:01:05 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] Created reservations ['25f3a5ba-d30f-498c-82e3-2b51594099f8', '7bdbe20c-53ed-47ba-acb1-4bd1943b0e1e', '3cb5ecf6-e01d-46c4-b2b3-6e2af4437164', '0755290c-e572-4f0e-8663-0dd854b68a53'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:01:05 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-ac9e30c6-3ffc-4bc3-8b10-d82a8b469a1f tempest-GroupSnapshotsTest-846013661 None] group_snapshot fa90a6c5-1f5d-4fc5-8066-189878495994: deleted successfully Jul 14 13:01:05 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4b8905f4-bb65-49c8-9ebc-bc71b535039f tempest-VolumeQuotasAdminTestJSON-1307340175 None] Acquiring lock "cinder-4428d374-f1d6-4d5a-b96b-b31dec1d8e8c-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:01:05 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4b8905f4-bb65-49c8-9ebc-bc71b535039f tempest-VolumeQuotasAdminTestJSON-1307340175 None] Lock "cinder-4428d374-f1d6-4d5a-b96b-b31dec1d8e8c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:01:05 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4b8905f4-bb65-49c8-9ebc-bc71b535039f tempest-VolumeQuotasAdminTestJSON-1307340175 None] Acquiring lock "cinder-quobyte-4428d374-f1d6-4d5a-b96b-b31dec1d8e8c" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:01:05 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4b8905f4-bb65-49c8-9ebc-bc71b535039f tempest-VolumeQuotasAdminTestJSON-1307340175 None] Lock "cinder-quobyte-4428d374-f1d6-4d5a-b96b-b31dec1d8e8c" acquired by "delete_volume" :: waited 0.015s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:01:05 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[d595609f-54da-47c3-a411-1bd482ed90ab]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:01:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4b8905f4-bb65-49c8-9ebc-bc71b535039f tempest-VolumeQuotasAdminTestJSON-1307340175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4428d374-f1d6-4d5a-b96b-b31dec1d8e8c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:06 devstack sudo[94169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4428d374-f1d6-4d5a-b96b-b31dec1d8e8c Jul 14 13:01:06 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:06 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4b8905f4-bb65-49c8-9ebc-bc71b535039f tempest-VolumeQuotasAdminTestJSON-1307340175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4428d374-f1d6-4d5a-b96b-b31dec1d8e8c" returned: 0 in 0.357s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4b8905f4-bb65-49c8-9ebc-bc71b535039f tempest-VolumeQuotasAdminTestJSON-1307340175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4428d374-f1d6-4d5a-b96b-b31dec1d8e8c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:06 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4428d374-f1d6-4d5a-b96b-b31dec1d8e8c Jul 14 13:01:06 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:06 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4b8905f4-bb65-49c8-9ebc-bc71b535039f tempest-VolumeQuotasAdminTestJSON-1307340175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4428d374-f1d6-4d5a-b96b-b31dec1d8e8c" returned: 0 in 0.275s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4b8905f4-bb65-49c8-9ebc-bc71b535039f tempest-VolumeQuotasAdminTestJSON-1307340175 None] Lock "cinder-quobyte-4428d374-f1d6-4d5a-b96b-b31dec1d8e8c" released by "delete_volume" :: held 0.679s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:01:06 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-4b8905f4-bb65-49c8-9ebc-bc71b535039f tempest-VolumeQuotasAdminTestJSON-1307340175 None] Created reservations ['53d83db4-5584-48fe-a369-f4d11d37f6e5', 'a7852b3b-9055-458c-a74c-c82c30cc614f', '43bc3ccd-c0f0-4834-91a0-da9b682f3970', '70b029ff-66e6-450d-923b-a223b7945ced'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:01:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-89caf2ac-d906-462b-8afe-9ea4c0f39792 tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "cinder-quobyte-75d785ec-f82b-4586-892d-6c85513656e2" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:01:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-89caf2ac-d906-462b-8afe-9ea4c0f39792 tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-75d785ec-f82b-4586-892d-6c85513656e2" acquired by "delete_volume" :: waited 0.030s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:01:06 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dbea18-3698-45d0-948d-2faf4c1cc936]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:01:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-89caf2ac-d906-462b-8afe-9ea4c0f39792 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4b8905f4-bb65-49c8-9ebc-bc71b535039f tempest-VolumeQuotasAdminTestJSON-1307340175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:01:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4b8905f4-bb65-49c8-9ebc-bc71b535039f tempest-VolumeQuotasAdminTestJSON-1307340175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:01:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4b8905f4-bb65-49c8-9ebc-bc71b535039f tempest-VolumeQuotasAdminTestJSON-1307340175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:01:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4b8905f4-bb65-49c8-9ebc-bc71b535039f tempest-VolumeQuotasAdminTestJSON-1307340175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:01:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4b8905f4-bb65-49c8-9ebc-bc71b535039f tempest-VolumeQuotasAdminTestJSON-1307340175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:01:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4b8905f4-bb65-49c8-9ebc-bc71b535039f tempest-VolumeQuotasAdminTestJSON-1307340175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:06 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:01:06 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:06 devstack sudo[94177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2 Jul 14 13:01:06 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:07 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4b8905f4-bb65-49c8-9ebc-bc71b535039f tempest-VolumeQuotasAdminTestJSON-1307340175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.289s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:07 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-4b8905f4-bb65-49c8-9ebc-bc71b535039f tempest-VolumeQuotasAdminTestJSON-1307340175 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:01:07 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-4b8905f4-bb65-49c8-9ebc-bc71b535039f tempest-VolumeQuotasAdminTestJSON-1307340175 None] Deleted volume successfully. Jul 14 13:01:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4b8905f4-bb65-49c8-9ebc-bc71b535039f tempest-VolumeQuotasAdminTestJSON-1307340175 None] Lock "cinder-4428d374-f1d6-4d5a-b96b-b31dec1d8e8c-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:01:07 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-89caf2ac-d906-462b-8afe-9ea4c0f39792 tempest-GroupSnapshotsTest-846013661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2" returned: 0 in 0.450s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-89caf2ac-d906-462b-8afe-9ea4c0f39792 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:07 devstack sudo[94186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2 Jul 14 13:01:07 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:07 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-89caf2ac-d906-462b-8afe-9ea4c0f39792 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-75d785ec-f82b-4586-892d-6c85513656e2" returned: 0 in 0.264s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-89caf2ac-d906-462b-8afe-9ea4c0f39792 tempest-GroupSnapshotsTest-846013661 None] Lock "cinder-quobyte-75d785ec-f82b-4586-892d-6c85513656e2" released by "delete_volume" :: held 0.785s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:01:07 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-89caf2ac-d906-462b-8afe-9ea4c0f39792 tempest-GroupSnapshotsTest-846013661 None] Created reservations ['b4fc07f8-37ff-453d-a213-17a33e02efd8'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:01:07 devstack cinder-volume[86977]: WARNING cinder.quota [None req-89caf2ac-d906-462b-8afe-9ea4c0f39792 tempest-GroupSnapshotsTest-846013661 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1992106726 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1992106726, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:01:07 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-89caf2ac-d906-462b-8afe-9ea4c0f39792 tempest-GroupSnapshotsTest-846013661 None] Created reservations ['46091b8f-589d-4361-b3dd-9b3dcd98f78a', '7ef6cff0-0aae-4231-b060-84f6b6238756', 'a1e6085e-e9cb-404c-99bb-d75063d6a9d6', '70dea875-b935-422c-86a2-71556e6cff23'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:01:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-89caf2ac-d906-462b-8afe-9ea4c0f39792 tempest-GroupSnapshotsTest-846013661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:01:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-89caf2ac-d906-462b-8afe-9ea4c0f39792 tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:01:07 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-89caf2ac-d906-462b-8afe-9ea4c0f39792 tempest-GroupSnapshotsTest-846013661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:01:07 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-89caf2ac-d906-462b-8afe-9ea4c0f39792 tempest-GroupSnapshotsTest-846013661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:01:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-89caf2ac-d906-462b-8afe-9ea4c0f39792 tempest-GroupSnapshotsTest-846013661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:01:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-89caf2ac-d906-462b-8afe-9ea4c0f39792 tempest-GroupSnapshotsTest-846013661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:07 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:01:07 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:08 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-89caf2ac-d906-462b-8afe-9ea4c0f39792 tempest-GroupSnapshotsTest-846013661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.326s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:08 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-89caf2ac-d906-462b-8afe-9ea4c0f39792 tempest-GroupSnapshotsTest-846013661 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:01:08 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-89caf2ac-d906-462b-8afe-9ea4c0f39792 tempest-GroupSnapshotsTest-846013661 None] Delete group completed successfully. Jul 14 13:01:15 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:01:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Flow 'volume_create_manager' (e1d0e57a-ed47-41ab-a0e2-a2f3010ae904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:01:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a72bfb-da6c-4766-a9c3-ef8581835049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a72bfb-da6c-4766-a9c3-ef8581835049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-613273033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a2376d-4331-41aa-b7b6-6c11b233407c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f7098c249c44cf8bd827247a79af3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:01:16Z,use_quota=True,user_id='a273b7f1eaff4dedbdbfec2ecfc12271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b8c608-dde4-443b-8320-5a80d1b8ab27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b8c608-dde4-443b-8320-5a80d1b8ab27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9d691f-6e7a-4596-a5ac-95879f3f2160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9d691f-6e7a-4596-a5ac-95879f3f2160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63a2376d-4331-41aa-b7b6-6c11b233407c', 'volume_name': 'volume-63a2376d-4331-41aa-b7b6-6c11b233407c', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5795eb73-b61a-4507-b656-2885d886949b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5795eb73-b61a-4507-b656-2885d886949b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aab1286-d2e0-4591-991c-bf133b9fb4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:15 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Volume 63a2376d-4331-41aa-b7b6-6c11b233407c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63a2376d-4331-41aa-b7b6-6c11b233407c', 'volume_size': 1} Jul 14 13:01:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:01:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:01:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-613273033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a2376d-4331-41aa-b7b6-6c11b233407c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f7098c249c44cf8bd827247a79af3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:01:16Z,use_quota=True,user_id='a273b7f1eaff4dedbdbfec2ecfc12271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:01:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Creating volume 63a2376d-4331-41aa-b7b6-6c11b233407c {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:01:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:01:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:01:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:01:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:01:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:01:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:01:15 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:01:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-63a2376d-4331-41aa-b7b6-6c11b233407c 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:15 devstack sudo[94245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-63a2376d-4331-41aa-b7b6-6c11b233407c 1073741824 Jul 14 13:01:15 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:16 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-63a2376d-4331-41aa-b7b6-6c11b233407c 1073741824" returned: 0 in 0.623s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-63a2376d-4331-41aa-b7b6-6c11b233407c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:16 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-63a2376d-4331-41aa-b7b6-6c11b233407c Jul 14 13:01:16 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:01:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:01:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:01:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:01:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:01:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:01:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:16 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:01:16 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:16 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-63a2376d-4331-41aa-b7b6-6c11b233407c" returned: 0 in 0.360s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:01:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:01:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aab1286-d2e0-4591-991c-bf133b9fb4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63a2376d-4331-41aa-b7b6-6c11b233407c', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcbffd3c-cfbb-4402-b5bb-94b261ee699f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:16 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Volume volume-63a2376d-4331-41aa-b7b6-6c11b233407c (63a2376d-4331-41aa-b7b6-6c11b233407c): created successfully Jul 14 13:01:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcbffd3c-cfbb-4402-b5bb-94b261ee699f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Flow 'volume_create_manager' (e1d0e57a-ed47-41ab-a0e2-a2f3010ae904) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:01:16 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-7db4f9c4-447e-4eaa-ba94-d5c252833f8d tempest-VolumeQuotasNegativeTestJSON-358393834 None] Created volume successfully. Jul 14 13:01:16 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.306s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:01:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:01:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 8 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 13:01:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 13:01:17 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-cc2bd19f-52c3-4017-bcd4-56f7591815a0 req-9a6ff69e-666d-465a-845a-9bd66e048f96 tempest-ServerActionsTestOtherA-1628124989 None] Terminate volume connection completed successfully. Jul 14 13:01:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-cc2bd19f-52c3-4017-bcd4-56f7591815a0 req-9a6ff69e-666d-465a-845a-9bd66e048f96 tempest-ServerActionsTestOtherA-1628124989 None] Deleting attachment 8a3bbf2e-f1fb-4ca3-9289-2258785b1d21. {{(pid=86977) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 13:01:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bf61e911-1356-413c-9523-5bae2ab25e32 tempest-VolumeQuotasNegativeTestJSON-358393834 None] Acquiring lock "cinder-63a2376d-4331-41aa-b7b6-6c11b233407c-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:01:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bf61e911-1356-413c-9523-5bae2ab25e32 tempest-VolumeQuotasNegativeTestJSON-358393834 None] Lock "cinder-63a2376d-4331-41aa-b7b6-6c11b233407c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:01:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bf61e911-1356-413c-9523-5bae2ab25e32 tempest-VolumeQuotasNegativeTestJSON-358393834 None] Acquiring lock "cinder-quobyte-63a2376d-4331-41aa-b7b6-6c11b233407c" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:01:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bf61e911-1356-413c-9523-5bae2ab25e32 tempest-VolumeQuotasNegativeTestJSON-358393834 None] Lock "cinder-quobyte-63a2376d-4331-41aa-b7b6-6c11b233407c" acquired by "delete_volume" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:01:19 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc429bb7-2b32-4d75-9792-a88965cb89ea]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:01:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bf61e911-1356-413c-9523-5bae2ab25e32 tempest-VolumeQuotasNegativeTestJSON-358393834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-63a2376d-4331-41aa-b7b6-6c11b233407c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:19 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-63a2376d-4331-41aa-b7b6-6c11b233407c Jul 14 13:01:19 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:19 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bf61e911-1356-413c-9523-5bae2ab25e32 tempest-VolumeQuotasNegativeTestJSON-358393834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-63a2376d-4331-41aa-b7b6-6c11b233407c" returned: 0 in 0.486s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bf61e911-1356-413c-9523-5bae2ab25e32 tempest-VolumeQuotasNegativeTestJSON-358393834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-63a2376d-4331-41aa-b7b6-6c11b233407c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:19 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-63a2376d-4331-41aa-b7b6-6c11b233407c Jul 14 13:01:19 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:20 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bf61e911-1356-413c-9523-5bae2ab25e32 tempest-VolumeQuotasNegativeTestJSON-358393834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-63a2376d-4331-41aa-b7b6-6c11b233407c" returned: 0 in 0.290s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bf61e911-1356-413c-9523-5bae2ab25e32 tempest-VolumeQuotasNegativeTestJSON-358393834 None] Lock "cinder-quobyte-63a2376d-4331-41aa-b7b6-6c11b233407c" released by "delete_volume" :: held 0.852s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:01:20 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-bf61e911-1356-413c-9523-5bae2ab25e32 tempest-VolumeQuotasNegativeTestJSON-358393834 None] Created reservations ['84694eb9-1808-4a22-9962-1c27517633e3', 'e51969d9-09ab-4cec-9fb5-054b8dac16c2', 'ee4f9bb2-300a-4887-a163-86cb19074e87', '9e7a68ca-4a88-4841-952e-9eba85d463e4'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:01:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bf61e911-1356-413c-9523-5bae2ab25e32 tempest-VolumeQuotasNegativeTestJSON-358393834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:01:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bf61e911-1356-413c-9523-5bae2ab25e32 tempest-VolumeQuotasNegativeTestJSON-358393834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:01:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-bf61e911-1356-413c-9523-5bae2ab25e32 tempest-VolumeQuotasNegativeTestJSON-358393834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:01:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-bf61e911-1356-413c-9523-5bae2ab25e32 tempest-VolumeQuotasNegativeTestJSON-358393834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:01:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bf61e911-1356-413c-9523-5bae2ab25e32 tempest-VolumeQuotasNegativeTestJSON-358393834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:01:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bf61e911-1356-413c-9523-5bae2ab25e32 tempest-VolumeQuotasNegativeTestJSON-358393834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:20 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:01:20 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:20 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bf61e911-1356-413c-9523-5bae2ab25e32 tempest-VolumeQuotasNegativeTestJSON-358393834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.371s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:20 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-bf61e911-1356-413c-9523-5bae2ab25e32 tempest-VolumeQuotasNegativeTestJSON-358393834 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:01:20 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-bf61e911-1356-413c-9523-5bae2ab25e32 tempest-VolumeQuotasNegativeTestJSON-358393834 None] Deleted volume successfully. Jul 14 13:01:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bf61e911-1356-413c-9523-5bae2ab25e32 tempest-VolumeQuotasNegativeTestJSON-358393834 None] Lock "cinder-63a2376d-4331-41aa-b7b6-6c11b233407c-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:01:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-abc0d5e8-6fb9-452f-bc72-1a93bdaf7497 tempest-ServerActionsTestOtherA-1628124989 None] Acquiring lock "cinder-d8c1c9e6-14ba-4804-8511-0c6c4afe8570-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:01:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-abc0d5e8-6fb9-452f-bc72-1a93bdaf7497 tempest-ServerActionsTestOtherA-1628124989 None] Lock "cinder-d8c1c9e6-14ba-4804-8511-0c6c4afe8570-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:01:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-abc0d5e8-6fb9-452f-bc72-1a93bdaf7497 tempest-ServerActionsTestOtherA-1628124989 None] Acquiring lock "cinder-quobyte-d8c1c9e6-14ba-4804-8511-0c6c4afe8570" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:01:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-abc0d5e8-6fb9-452f-bc72-1a93bdaf7497 tempest-ServerActionsTestOtherA-1628124989 None] Lock "cinder-quobyte-d8c1c9e6-14ba-4804-8511-0c6c4afe8570" acquired by "delete_volume" :: waited 0.040s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:01:22 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94f9491-6e04-4c89-9a7b-9198b32a4534]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:01:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-abc0d5e8-6fb9-452f-bc72-1a93bdaf7497 tempest-ServerActionsTestOtherA-1628124989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:22 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570 Jul 14 13:01:22 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:22 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-abc0d5e8-6fb9-452f-bc72-1a93bdaf7497 tempest-ServerActionsTestOtherA-1628124989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570" returned: 0 in 0.428s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-abc0d5e8-6fb9-452f-bc72-1a93bdaf7497 tempest-ServerActionsTestOtherA-1628124989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:22 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570 Jul 14 13:01:22 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:22 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-abc0d5e8-6fb9-452f-bc72-1a93bdaf7497 tempest-ServerActionsTestOtherA-1628124989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8c1c9e6-14ba-4804-8511-0c6c4afe8570" returned: 0 in 0.310s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-abc0d5e8-6fb9-452f-bc72-1a93bdaf7497 tempest-ServerActionsTestOtherA-1628124989 None] Lock "cinder-quobyte-d8c1c9e6-14ba-4804-8511-0c6c4afe8570" released by "delete_volume" :: held 0.810s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:01:23 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-abc0d5e8-6fb9-452f-bc72-1a93bdaf7497 tempest-ServerActionsTestOtherA-1628124989 None] Created reservations ['815eeb08-30a4-4b73-a2b2-dd3cc062180f', 'b8c8f17c-0452-4dc3-ad6d-e0ab08be31f9', '6e3369af-fbfb-4473-9104-88f7d0dd7ebf', '516019e0-e319-4743-a7d5-6ef40d4571c7'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:01:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-abc0d5e8-6fb9-452f-bc72-1a93bdaf7497 tempest-ServerActionsTestOtherA-1628124989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:01:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-abc0d5e8-6fb9-452f-bc72-1a93bdaf7497 tempest-ServerActionsTestOtherA-1628124989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:01:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-abc0d5e8-6fb9-452f-bc72-1a93bdaf7497 tempest-ServerActionsTestOtherA-1628124989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:01:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-abc0d5e8-6fb9-452f-bc72-1a93bdaf7497 tempest-ServerActionsTestOtherA-1628124989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:01:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-abc0d5e8-6fb9-452f-bc72-1a93bdaf7497 tempest-ServerActionsTestOtherA-1628124989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:01:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-abc0d5e8-6fb9-452f-bc72-1a93bdaf7497 tempest-ServerActionsTestOtherA-1628124989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:23 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:01:23 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:23 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-abc0d5e8-6fb9-452f-bc72-1a93bdaf7497 tempest-ServerActionsTestOtherA-1628124989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.384s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:23 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-abc0d5e8-6fb9-452f-bc72-1a93bdaf7497 tempest-ServerActionsTestOtherA-1628124989 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:01:23 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-abc0d5e8-6fb9-452f-bc72-1a93bdaf7497 tempest-ServerActionsTestOtherA-1628124989 None] Deleted volume successfully. Jul 14 13:01:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-abc0d5e8-6fb9-452f-bc72-1a93bdaf7497 tempest-ServerActionsTestOtherA-1628124989 None] Lock "cinder-d8c1c9e6-14ba-4804-8511-0c6c4afe8570-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:01:24 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:01:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Flow 'volume_create_manager' (ce8e43ad-8373-465f-8d1e-0d69f5ebf261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:01:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f220f05f-5f96-470c-ba73-661fdee0f4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f220f05f-5f96-470c-ba73-661fdee0f4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-827977116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16549cc9-1829-4b61-8a3c-dd4d4fdf38a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fc20c5c3cd499e8bffabc4f576a12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:01:24Z,use_quota=True,user_id='71e60636ccec4bc9bc0c94033bca753f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d26730-8de3-419e-bc22-942955f4db13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d26730-8de3-419e-bc22-942955f4db13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac5c250-3901-4129-839a-575372b6a55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac5c250-3901-4129-839a-575372b6a55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16549cc9-1829-4b61-8a3c-dd4d4fdf38a9', 'volume_name': 'volume-16549cc9-1829-4b61-8a3c-dd4d4fdf38a9', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc077a3a-3163-42ee-9c22-34cc7bca4713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc077a3a-3163-42ee-9c22-34cc7bca4713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4f5a2e-947f-4926-9024-90074d95b937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:24 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Volume 16549cc9-1829-4b61-8a3c-dd4d4fdf38a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16549cc9-1829-4b61-8a3c-dd4d4fdf38a9', 'volume_size': 1} Jul 14 13:01:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:01:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:01:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-827977116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16549cc9-1829-4b61-8a3c-dd4d4fdf38a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fc20c5c3cd499e8bffabc4f576a12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:01:24Z,use_quota=True,user_id='71e60636ccec4bc9bc0c94033bca753f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:01:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Creating volume 16549cc9-1829-4b61-8a3c-dd4d4fdf38a9 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:01:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:01:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:01:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:01:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:01:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:01:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:01:24 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:01:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16549cc9-1829-4b61-8a3c-dd4d4fdf38a9 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:24 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16549cc9-1829-4b61-8a3c-dd4d4fdf38a9 1073741824 Jul 14 13:01:24 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:25 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16549cc9-1829-4b61-8a3c-dd4d4fdf38a9 1073741824" returned: 0 in 0.733s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16549cc9-1829-4b61-8a3c-dd4d4fdf38a9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:25 devstack sudo[94376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16549cc9-1829-4b61-8a3c-dd4d4fdf38a9 Jul 14 13:01:25 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:25 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16549cc9-1829-4b61-8a3c-dd4d4fdf38a9" returned: 0 in 0.363s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:01:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:01:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4f5a2e-947f-4926-9024-90074d95b937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16549cc9-1829-4b61-8a3c-dd4d4fdf38a9', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792eec68-f888-4047-a2af-00df497287d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:25 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Volume volume-16549cc9-1829-4b61-8a3c-dd4d4fdf38a9 (16549cc9-1829-4b61-8a3c-dd4d4fdf38a9): created successfully Jul 14 13:01:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792eec68-f888-4047-a2af-00df497287d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Flow 'volume_create_manager' (ce8e43ad-8373-465f-8d1e-0d69f5ebf261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:01:25 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e1f70a24-deac-4652-a7bf-8f9e862d5d18 tempest-VolumesServicesTestJSON-854607372 None] Created volume successfully. Jul 14 13:01:26 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1abc681-e459-4b41-8895-6e849f1f8354 tempest-VolumesServicesTestJSON-854607372 None] Acquiring lock "cinder-16549cc9-1829-4b61-8a3c-dd4d4fdf38a9-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:01:26 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1abc681-e459-4b41-8895-6e849f1f8354 tempest-VolumesServicesTestJSON-854607372 None] Lock "cinder-16549cc9-1829-4b61-8a3c-dd4d4fdf38a9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:01:26 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1abc681-e459-4b41-8895-6e849f1f8354 tempest-VolumesServicesTestJSON-854607372 None] Acquiring lock "cinder-quobyte-16549cc9-1829-4b61-8a3c-dd4d4fdf38a9" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:01:26 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1abc681-e459-4b41-8895-6e849f1f8354 tempest-VolumesServicesTestJSON-854607372 None] Lock "cinder-quobyte-16549cc9-1829-4b61-8a3c-dd4d4fdf38a9" acquired by "delete_volume" :: waited 0.015s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:01:26 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[327b4d41-623a-48e2-b51b-e2dcf08c58a9]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:01:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1abc681-e459-4b41-8895-6e849f1f8354 tempest-VolumesServicesTestJSON-854607372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16549cc9-1829-4b61-8a3c-dd4d4fdf38a9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:26 devstack sudo[94382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16549cc9-1829-4b61-8a3c-dd4d4fdf38a9 Jul 14 13:01:26 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:27 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1abc681-e459-4b41-8895-6e849f1f8354 tempest-VolumesServicesTestJSON-854607372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16549cc9-1829-4b61-8a3c-dd4d4fdf38a9" returned: 0 in 0.525s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1abc681-e459-4b41-8895-6e849f1f8354 tempest-VolumesServicesTestJSON-854607372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16549cc9-1829-4b61-8a3c-dd4d4fdf38a9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:27 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16549cc9-1829-4b61-8a3c-dd4d4fdf38a9 Jul 14 13:01:27 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:27 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1abc681-e459-4b41-8895-6e849f1f8354 tempest-VolumesServicesTestJSON-854607372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-16549cc9-1829-4b61-8a3c-dd4d4fdf38a9" returned: 0 in 0.392s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1abc681-e459-4b41-8895-6e849f1f8354 tempest-VolumesServicesTestJSON-854607372 None] Lock "cinder-quobyte-16549cc9-1829-4b61-8a3c-dd4d4fdf38a9" released by "delete_volume" :: held 0.985s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:01:27 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-c1abc681-e459-4b41-8895-6e849f1f8354 tempest-VolumesServicesTestJSON-854607372 None] Created reservations ['322b552f-8661-43fd-966c-252ba40ddbf6', '5d0ae857-c37a-4a6c-a82b-11011aea8cb3', '13d19d10-dc60-403e-801c-d39c54561ed5', 'afe860c8-bc21-4ad5-a763-dfbfb8fb4688'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:01:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c1abc681-e459-4b41-8895-6e849f1f8354 tempest-VolumesServicesTestJSON-854607372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:01:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c1abc681-e459-4b41-8895-6e849f1f8354 tempest-VolumesServicesTestJSON-854607372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:01:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c1abc681-e459-4b41-8895-6e849f1f8354 tempest-VolumesServicesTestJSON-854607372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:01:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c1abc681-e459-4b41-8895-6e849f1f8354 tempest-VolumesServicesTestJSON-854607372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:01:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c1abc681-e459-4b41-8895-6e849f1f8354 tempest-VolumesServicesTestJSON-854607372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:01:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1abc681-e459-4b41-8895-6e849f1f8354 tempest-VolumesServicesTestJSON-854607372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:27 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:01:27 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:28 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1abc681-e459-4b41-8895-6e849f1f8354 tempest-VolumesServicesTestJSON-854607372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.311s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:28 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-c1abc681-e459-4b41-8895-6e849f1f8354 tempest-VolumesServicesTestJSON-854607372 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:01:28 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c1abc681-e459-4b41-8895-6e849f1f8354 tempest-VolumesServicesTestJSON-854607372 None] Deleted volume successfully. Jul 14 13:01:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1abc681-e459-4b41-8895-6e849f1f8354 tempest-VolumesServicesTestJSON-854607372 None] Lock "cinder-16549cc9-1829-4b61-8a3c-dd4d4fdf38a9-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:01:28 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:01:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Flow 'volume_create_manager' (053d9973-7ade-4106-85c1-b071558e6e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:01:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0171d18c-17ef-4ada-8c7f-cb5b7de81190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0171d18c-17ef-4ada-8c7f-cb5b7de81190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1022312173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ae30365-3766-409a-b9ee-e176651e8693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42f060b39ff649c980c6695cb406c7e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:01:29Z,use_quota=True,user_id='4b8b88cbe6894d8498806823f007f847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e265187f-04fd-48bb-9ef9-58d078840bc4),volume_type_id=e265187f-04fd-48bb-9ef9-58d078840bc4)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef6f57c-7d0b-4dc8-94ec-af06d3d9c7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef6f57c-7d0b-4dc8-94ec-af06d3d9c7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1fb40b5-fc50-42a8-b857-a6dce63ac7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1fb40b5-fc50-42a8-b857-a6dce63ac7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ae30365-3766-409a-b9ee-e176651e8693', 'volume_name': 'volume-7ae30365-3766-409a-b9ee-e176651e8693', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb14bb9-9086-4eaa-9438-17ba627fb6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb14bb9-9086-4eaa-9438-17ba627fb6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c58ba4-5bdd-46b8-b247-3ea96108e2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:29 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Volume 7ae30365-3766-409a-b9ee-e176651e8693: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ae30365-3766-409a-b9ee-e176651e8693', 'volume_size': 1} Jul 14 13:01:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:01:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:01:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1022312173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ae30365-3766-409a-b9ee-e176651e8693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42f060b39ff649c980c6695cb406c7e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:01:29Z,use_quota=True,user_id='4b8b88cbe6894d8498806823f007f847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e265187f-04fd-48bb-9ef9-58d078840bc4),volume_type_id=e265187f-04fd-48bb-9ef9-58d078840bc4)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:01:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Creating volume 7ae30365-3766-409a-b9ee-e176651e8693 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:01:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:01:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:01:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:01:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:01:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:01:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:01:29 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:01:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ae30365-3766-409a-b9ee-e176651e8693 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:29 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ae30365-3766-409a-b9ee-e176651e8693 1073741824 Jul 14 13:01:29 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:29 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ae30365-3766-409a-b9ee-e176651e8693 1073741824" returned: 0 in 0.626s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ae30365-3766-409a-b9ee-e176651e8693 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:29 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ae30365-3766-409a-b9ee-e176651e8693 Jul 14 13:01:29 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:30 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ae30365-3766-409a-b9ee-e176651e8693" returned: 0 in 0.363s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:01:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:01:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c58ba4-5bdd-46b8-b247-3ea96108e2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ae30365-3766-409a-b9ee-e176651e8693', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15dd21c1-cdb2-4100-91f3-c09266d55fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:30 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Volume volume-7ae30365-3766-409a-b9ee-e176651e8693 (7ae30365-3766-409a-b9ee-e176651e8693): created successfully Jul 14 13:01:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15dd21c1-cdb2-4100-91f3-c09266d55fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Flow 'volume_create_manager' (053d9973-7ade-4106-85c1-b071558e6e0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:01:30 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e64dda22-046b-412c-9168-5dd5edaaea13 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Created volume successfully. Jul 14 13:01:30 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-23395d00-bc08-4965-8b72-78c2da491688 req-f9a3b65d-ce43-4897-8793-4d3edc7f5aae tempest-AttachVolumeNegativeTest-115818279 None] Terminate volume connection completed successfully. Jul 14 13:01:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-23395d00-bc08-4965-8b72-78c2da491688 req-f9a3b65d-ce43-4897-8793-4d3edc7f5aae tempest-AttachVolumeNegativeTest-115818279 None] Deleting attachment dc29ac48-a3e9-48b3-b79b-f9cf61148b56. {{(pid=86977) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 13:01:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-21ee8d8d-f2fb-40b7-bdac-2903525b7113 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:01:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-21ee8d8d-f2fb-40b7-bdac-2903525b7113 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:01:31 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-21ee8d8d-f2fb-40b7-bdac-2903525b7113 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:01:31 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-21ee8d8d-f2fb-40b7-bdac-2903525b7113 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:01:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-21ee8d8d-f2fb-40b7-bdac-2903525b7113 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:01:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-21ee8d8d-f2fb-40b7-bdac-2903525b7113 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:31 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:01:31 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:32 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-21ee8d8d-f2fb-40b7-bdac-2903525b7113 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.477s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:32 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-21ee8d8d-f2fb-40b7-bdac-2903525b7113 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:01:32 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-21ee8d8d-f2fb-40b7-bdac-2903525b7113 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Retype volume completed successfully. Jul 14 13:01:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f4d90fc8-5a61-4024-a6f7-11209e998e81 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Acquiring lock "cinder-7ae30365-3766-409a-b9ee-e176651e8693-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:01:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f4d90fc8-5a61-4024-a6f7-11209e998e81 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Lock "cinder-7ae30365-3766-409a-b9ee-e176651e8693-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:01:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f4d90fc8-5a61-4024-a6f7-11209e998e81 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Acquiring lock "cinder-quobyte-7ae30365-3766-409a-b9ee-e176651e8693" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:01:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f4d90fc8-5a61-4024-a6f7-11209e998e81 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Lock "cinder-quobyte-7ae30365-3766-409a-b9ee-e176651e8693" acquired by "delete_volume" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:01:32 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d8ad25-bd35-4e6c-832d-f5546af79fc7]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:01:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f4d90fc8-5a61-4024-a6f7-11209e998e81 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ae30365-3766-409a-b9ee-e176651e8693 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:33 devstack sudo[94435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ae30365-3766-409a-b9ee-e176651e8693 Jul 14 13:01:33 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:33 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f4d90fc8-5a61-4024-a6f7-11209e998e81 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ae30365-3766-409a-b9ee-e176651e8693" returned: 0 in 0.534s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f4d90fc8-5a61-4024-a6f7-11209e998e81 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ae30365-3766-409a-b9ee-e176651e8693 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:33 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ae30365-3766-409a-b9ee-e176651e8693 Jul 14 13:01:33 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:33 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f4d90fc8-5a61-4024-a6f7-11209e998e81 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ae30365-3766-409a-b9ee-e176651e8693" returned: 0 in 0.417s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f4d90fc8-5a61-4024-a6f7-11209e998e81 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Lock "cinder-quobyte-7ae30365-3766-409a-b9ee-e176651e8693" released by "delete_volume" :: held 1.013s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:01:34 devstack cinder-volume[86977]: WARNING cinder.quota [None req-f4d90fc8-5a61-4024-a6f7-11209e998e81 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:01:34 devstack cinder-volume[86977]: WARNING cinder.quota [None req-f4d90fc8-5a61-4024-a6f7-11209e998e81 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:01:34 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-f4d90fc8-5a61-4024-a6f7-11209e998e81 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Created reservations ['b7f97248-0468-4417-957f-1a830f3d620c', 'f386d6ba-7a8f-42b4-bff7-2d3ec24c0436', '11972932-395e-449a-b1b3-2caf9191e987', '73f88406-24a6-4c3d-b94b-dca897bc6426'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:01:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f4d90fc8-5a61-4024-a6f7-11209e998e81 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:01:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f4d90fc8-5a61-4024-a6f7-11209e998e81 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:01:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f4d90fc8-5a61-4024-a6f7-11209e998e81 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:01:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f4d90fc8-5a61-4024-a6f7-11209e998e81 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:01:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f4d90fc8-5a61-4024-a6f7-11209e998e81 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:01:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f4d90fc8-5a61-4024-a6f7-11209e998e81 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:34 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:01:34 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:34 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f4d90fc8-5a61-4024-a6f7-11209e998e81 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.299s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:34 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-f4d90fc8-5a61-4024-a6f7-11209e998e81 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:01:34 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-f4d90fc8-5a61-4024-a6f7-11209e998e81 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Deleted volume successfully. Jul 14 13:01:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f4d90fc8-5a61-4024-a6f7-11209e998e81 tempest-VolumeRetypeWithoutMigrationTest-2047834184 None] Lock "cinder-7ae30365-3766-409a-b9ee-e176651e8693-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:01:36 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Flow 'volume_create_manager' (0bab81da-300e-4ef6-a57c-1db7cada1737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ae422c-404d-416c-adce-9ccc4ee10b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ae422c-404d-416c-adce-9ccc4ee10b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1936801568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d95d51b-26a6-4139-9027-0a2fcf365bc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5abd3ff4790749d588c9316edc4e549c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:01:37Z,use_quota=True,user_id='5cc2700771254370976abb895ec2048a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fa9c9c-5120-4677-8f1e-3250b24c6fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fa9c9c-5120-4677-8f1e-3250b24c6fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6aade77-6343-4e1e-b632-03dcd3f78898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6aade77-6343-4e1e-b632-03dcd3f78898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d95d51b-26a6-4139-9027-0a2fcf365bc7', 'volume_name': 'volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce6f7ef-58bd-4517-abcb-81ddeabcef01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce6f7ef-58bd-4517-abcb-81ddeabcef01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ca91bd-066b-48ba-90c7-a42a76d4e83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:37 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Volume 6d95d51b-26a6-4139-9027-0a2fcf365bc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7', 'volume_size': 1} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1936801568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d95d51b-26a6-4139-9027-0a2fcf365bc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5abd3ff4790749d588c9316edc4e549c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:01:37Z,use_quota=True,user_id='5cc2700771254370976abb895ec2048a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Creating volume 6d95d51b-26a6-4139-9027-0a2fcf365bc7 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:01:37 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:37 devstack sudo[94451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7 1073741824 Jul 14 13:01:37 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:37 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7 1073741824" returned: 0 in 0.565s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:37 devstack sudo[94457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7 Jul 14 13:01:37 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:37 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7" returned: 0 in 0.274s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:01:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:01:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ca91bd-066b-48ba-90c7-a42a76d4e83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b833c47-4c23-4f3a-b75d-acca9d2cfef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:38 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Volume volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7 (6d95d51b-26a6-4139-9027-0a2fcf365bc7): created successfully Jul 14 13:01:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b833c47-4c23-4f3a-b75d-acca9d2cfef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Flow 'volume_create_manager' (0bab81da-300e-4ef6-a57c-1db7cada1737) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:01:38 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-82c631be-cfff-43c1-a7c5-84425cb98912 tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Created volume successfully. Jul 14 13:01:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6d6a10d7-d9d3-482b-8941-5ac2a376bd6f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:01:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6d6a10d7-d9d3-482b-8941-5ac2a376bd6f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:01:39 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-6d6a10d7-d9d3-482b-8941-5ac2a376bd6f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Creating offline snapshot d834e388-7b89-4e09-afbf-3699f967923a of volume 6d95d51b-26a6-4139-9027-0a2fcf365bc7 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:01:39 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[284f17a2-50e6-4e92-89db-a3f4c15086a3]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:01:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d6a10d7-d9d3-482b-8941-5ac2a376bd6f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:39 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7 Jul 14 13:01:39 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:39 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d6a10d7-d9d3-482b-8941-5ac2a376bd6f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7" returned: 0 in 0.466s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d6a10d7-d9d3-482b-8941-5ac2a376bd6f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.d834e388-7b89-4e09-afbf-3699f967923a 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:39 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.d834e388-7b89-4e09-afbf-3699f967923a 1G Jul 14 13:01:39 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:40 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d6a10d7-d9d3-482b-8941-5ac2a376bd6f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.d834e388-7b89-4e09-afbf-3699f967923a 1G" returned: 0 in 0.511s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d6a10d7-d9d3-482b-8941-5ac2a376bd6f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.d834e388-7b89-4e09-afbf-3699f967923a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:40 devstack sudo[94472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.d834e388-7b89-4e09-afbf-3699f967923a Jul 14 13:01:40 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:40 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d6a10d7-d9d3-482b-8941-5ac2a376bd6f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.d834e388-7b89-4e09-afbf-3699f967923a" returned: 0 in 0.345s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:40 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-6d6a10d7-d9d3-482b-8941-5ac2a376bd6f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.d834e388-7b89-4e09-afbf-3699f967923a is being set with open permissions: ugo+rw Jul 14 13:01:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d6a10d7-d9d3-482b-8941-5ac2a376bd6f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.d834e388-7b89-4e09-afbf-3699f967923a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:40 devstack sudo[94480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.d834e388-7b89-4e09-afbf-3699f967923a Jul 14 13:01:40 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:40 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d6a10d7-d9d3-482b-8941-5ac2a376bd6f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.d834e388-7b89-4e09-afbf-3699f967923a" returned: 0 in 0.290s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d6a10d7-d9d3-482b-8941-5ac2a376bd6f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:41 devstack sudo[94483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.info Jul 14 13:01:41 devstack sudo[94483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:41 devstack sudo[94483]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d6a10d7-d9d3-482b-8941-5ac2a376bd6f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.info" returned: 0 in 0.343s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:41 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-6d6a10d7-d9d3-482b-8941-5ac2a376bd6f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.info is being set with open permissions: ugo+rw Jul 14 13:01:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d6a10d7-d9d3-482b-8941-5ac2a376bd6f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:41 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.info Jul 14 13:01:41 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:41 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d6a10d7-d9d3-482b-8941-5ac2a376bd6f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.info" returned: 0 in 0.301s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6d6a10d7-d9d3-482b-8941-5ac2a376bd6f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.383s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:01:41 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-6d6a10d7-d9d3-482b-8941-5ac2a376bd6f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Create snapshot completed successfully Jul 14 13:01:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-8c844e88-8429-40ca-8f49-6082c3eb810f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Acquiring lock "cinder-d834e388-7b89-4e09-afbf-3699f967923a-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:01:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-8c844e88-8429-40ca-8f49-6082c3eb810f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Lock "cinder-d834e388-7b89-4e09-afbf-3699f967923a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:01:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-8c844e88-8429-40ca-8f49-6082c3eb810f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Acquiring lock "cinder-quobyte-6d95d51b-26a6-4139-9027-0a2fcf365bc7" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:01:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-8c844e88-8429-40ca-8f49-6082c3eb810f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Lock "cinder-quobyte-6d95d51b-26a6-4139-9027-0a2fcf365bc7" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:01:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-8c844e88-8429-40ca-8f49-6082c3eb810f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Acquiring lock "cinder-quobyte-d834e388-7b89-4e09-afbf-3699f967923a" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:01:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-8c844e88-8429-40ca-8f49-6082c3eb810f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Lock "cinder-quobyte-d834e388-7b89-4e09-afbf-3699f967923a" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:01:43 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-8c844e88-8429-40ca-8f49-6082c3eb810f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Deleting offline snapshot d834e388-7b89-4e09-afbf-3699f967923a of volume 6d95d51b-26a6-4139-9027-0a2fcf365bc7 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:01:43 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-8c844e88-8429-40ca-8f49-6082c3eb810f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] snapshot_file for this snap is: volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.d834e388-7b89-4e09-afbf-3699f967923a {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:01:43 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a9063e-b0a9-41d6-88ae-bf3061040291]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:01:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8c844e88-8429-40ca-8f49-6082c3eb810f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.d834e388-7b89-4e09-afbf-3699f967923a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:43 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.d834e388-7b89-4e09-afbf-3699f967923a Jul 14 13:01:43 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:44 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8c844e88-8429-40ca-8f49-6082c3eb810f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.d834e388-7b89-4e09-afbf-3699f967923a" returned: 0 in 0.629s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:44 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-8c844e88-8429-40ca-8f49-6082c3eb810f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:01:44 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[1092396c-4282-4cb4-af40-ddd0f1eabbfb]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:01:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8c844e88-8429-40ca-8f49-6082c3eb810f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:44 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7 Jul 14 13:01:44 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:44 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8c844e88-8429-40ca-8f49-6082c3eb810f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7" returned: 0 in 0.472s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8c844e88-8429-40ca-8f49-6082c3eb810f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.d834e388-7b89-4e09-afbf-3699f967923a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:44 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.d834e388-7b89-4e09-afbf-3699f967923a Jul 14 13:01:44 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:44 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8c844e88-8429-40ca-8f49-6082c3eb810f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.d834e388-7b89-4e09-afbf-3699f967923a" returned: 0 in 0.378s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8c844e88-8429-40ca-8f49-6082c3eb810f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.d834e388-7b89-4e09-afbf-3699f967923a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:44 devstack sudo[94524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.d834e388-7b89-4e09-afbf-3699f967923a Jul 14 13:01:44 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:45 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8c844e88-8429-40ca-8f49-6082c3eb810f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7.d834e388-7b89-4e09-afbf-3699f967923a" returned: 0 in 0.281s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-8c844e88-8429-40ca-8f49-6082c3eb810f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Lock "cinder-quobyte-d834e388-7b89-4e09-afbf-3699f967923a" released by "_delete_snapshot" :: held 2.026s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:01:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-8c844e88-8429-40ca-8f49-6082c3eb810f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Lock "cinder-quobyte-6d95d51b-26a6-4139-9027-0a2fcf365bc7" released by "delete_snapshot" :: held 2.087s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:01:45 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-8c844e88-8429-40ca-8f49-6082c3eb810f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Created reservations ['3e0c5085-6acb-402c-a85e-938185bbdbbd', '85a2fd1d-8901-46e5-bcdd-be955d5fd874', '481ac199-3a10-4321-bd03-31d848cbeefb', '947f4f22-fafb-4ce7-b3f5-de8a583151a8'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:01:45 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-8c844e88-8429-40ca-8f49-6082c3eb810f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Delete snapshot completed successfully. Jul 14 13:01:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-8c844e88-8429-40ca-8f49-6082c3eb810f tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Lock "cinder-d834e388-7b89-4e09-afbf-3699f967923a-delete_snapshot" released by "delete_snapshot" :: held 2.283s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:01:46 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-8016b559-bdd4-445f-89ac-f925626df85c tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Acquiring lock "cinder-6d95d51b-26a6-4139-9027-0a2fcf365bc7-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:01:46 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-8016b559-bdd4-445f-89ac-f925626df85c tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Lock "cinder-6d95d51b-26a6-4139-9027-0a2fcf365bc7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:01:46 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-8016b559-bdd4-445f-89ac-f925626df85c tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Acquiring lock "cinder-quobyte-6d95d51b-26a6-4139-9027-0a2fcf365bc7" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:01:46 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-8016b559-bdd4-445f-89ac-f925626df85c tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Lock "cinder-quobyte-6d95d51b-26a6-4139-9027-0a2fcf365bc7" acquired by "delete_volume" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:01:46 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b8245e-b3cf-4def-bf01-2a0ff5945e30]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:01:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8016b559-bdd4-445f-89ac-f925626df85c tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:46 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7 Jul 14 13:01:46 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:47 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8016b559-bdd4-445f-89ac-f925626df85c tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7" returned: 0 in 0.450s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8016b559-bdd4-445f-89ac-f925626df85c tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:47 devstack sudo[94533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7 Jul 14 13:01:47 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:47 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8016b559-bdd4-445f-89ac-f925626df85c tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d95d51b-26a6-4139-9027-0a2fcf365bc7" returned: 0 in 0.390s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-8016b559-bdd4-445f-89ac-f925626df85c tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Lock "cinder-quobyte-6d95d51b-26a6-4139-9027-0a2fcf365bc7" released by "delete_volume" :: held 0.929s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:01:47 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-8016b559-bdd4-445f-89ac-f925626df85c tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Created reservations ['4df2494d-d1cb-423c-9419-2079d95a74f2', '43518a32-49e1-4628-9560-2217f3dca30e', 'dca204c7-47ed-4c91-9235-a56501abde87', 'b639ce42-5337-4246-917f-6be7dd9f8be5'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:01:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8016b559-bdd4-445f-89ac-f925626df85c tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:01:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8016b559-bdd4-445f-89ac-f925626df85c tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:01:47 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8016b559-bdd4-445f-89ac-f925626df85c tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:01:47 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8016b559-bdd4-445f-89ac-f925626df85c tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:01:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8016b559-bdd4-445f-89ac-f925626df85c tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:01:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8016b559-bdd4-445f-89ac-f925626df85c tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:47 devstack sudo[94537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:01:47 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:48 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8016b559-bdd4-445f-89ac-f925626df85c tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.383s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:48 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8016b559-bdd4-445f-89ac-f925626df85c tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:01:48 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-8016b559-bdd4-445f-89ac-f925626df85c tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Deleted volume successfully. Jul 14 13:01:48 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-8016b559-bdd4-445f-89ac-f925626df85c tempest-VolumeSnapshotQuotasNegativeTestJSON-1206049973 None] Lock "cinder-6d95d51b-26a6-4139-9027-0a2fcf365bc7-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:01:56 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=95,cinder:UPDATE=102,cinder:INSERT=30,cinder:DELETE=6 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:01:56 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=82,cinder:UPDATE=113,cinder:DELETE=9,cinder:INSERT=20 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:01:56 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:01:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Flow 'volume_create_manager' (be406401-7855-4e97-aa10-a824e0d0364f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:01:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff8eade-ae3e-4c68-8c66-1f91d862d759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff8eade-ae3e-4c68-8c66-1f91d862d759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1124866385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f69bd33f44de4ee2ad1e7fdded45e9ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:01:57Z,use_quota=True,user_id='2860f19f0cab4c4aa5d6c88f3d594745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf545792-ac7f-48d7-9be7-c54fda54bb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf545792-ac7f-48d7-9be7-c54fda54bb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e6b7c4-9d79-47fe-a594-78c9a2433be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:56 devstack cinder-volume[86977]: DEBUG cinder.image.glance [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Creating Keystone auth plugin from conf {{(pid=86977) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 13:01:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e6b7c4-9d79-47fe-a594-78c9a2433be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5', 'volume_name': 'volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5', 'volume_size': 1, 'image_id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cc8c62448314c45912011edd3ae5374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'created_at': datetime.datetime(2026, 7, 14, 10, 49, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 10, 49, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33abf4a9-ef06-4448-a45c-b53dca509874/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f01c06-2766-4ea0-b0d4-6d979a8d2bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f01c06-2766-4ea0-b0d4-6d979a8d2bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30ddf03-b8de-4c68-ac88-c8766b72bbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:58 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Volume f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5', 'volume_size': 1, 'image_id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cc8c62448314c45912011edd3ae5374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'created_at': datetime.datetime(2026, 7, 14, 10, 49, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 10, 49, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33abf4a9-ef06-4448-a45c-b53dca509874/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 14 13:01:58 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Trying to clone f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 from image 33abf4a9-ef06-4448-a45c-b53dca509874 at location (None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}]). {{(pid=86977) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 13:01:59 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_fc5jpccldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:751}} Jul 14 13:01:59 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Image download 20.69 MB at 20.69 MB/s Jul 14 13:01:59 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6849b84-4fd7-46b7-8dee-c7f27d11706e]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:01:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_fc5jpccldevstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:59 devstack sudo[94692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_fc5jpccldevstack@QuobyteHD Jul 14 13:01:59 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:01:59 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root Jul 14 13:01:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_fc5jpccldevstack@QuobyteHD" returned: 0 in 0.591s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:01:59 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Temporary image 33abf4a9-ef06-4448-a45c-b53dca509874 is fetched for user 2860f19f0cab4c4aa5d6c88f3d594745. {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:1450}} Jul 14 13:01:59 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f734de-c945-4387-aabf-557dbe071c71]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:01:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_fc5jpccldevstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:01:59 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:01:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Flow 'volume_create_manager' (d2625767-d4e3-401f-92ae-8a0de1601b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:01:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d618f3d2-c891-4068-9cef-c78bf72c05a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d618f3d2-c891-4068-9cef-c78bf72c05a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-699160908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c1ef9a1-7ef5-456e-864d-093564ee1b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95f33b5455e4d2fafda8f48fe1d2428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:02:00Z,use_quota=True,user_id='0a36a1a728fe4f02b69ba3aab32a8d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63586d27-48a0-41b8-b9fb-e2842768de99),volume_type_id=63586d27-48a0-41b8-b9fb-e2842768de99)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540a5026-4bb4-4842-9e3d-d39787a7b5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540a5026-4bb4-4842-9e3d-d39787a7b5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:01:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb2af4e5-620d-465f-a240-8ce3df631b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:01:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb2af4e5-620d-465f-a240-8ce3df631b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c1ef9a1-7ef5-456e-864d-093564ee1b1e', 'volume_name': 'volume-5c1ef9a1-7ef5-456e-864d-093564ee1b1e', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac009a8-0446-4d37-93eb-863b8f8708f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac009a8-0446-4d37-93eb-863b8f8708f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ca7593-0452-4b99-9e90-35a2436a4cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:00 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Volume 5c1ef9a1-7ef5-456e-864d-093564ee1b1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c1ef9a1-7ef5-456e-864d-093564ee1b1e', 'volume_size': 1} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-699160908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c1ef9a1-7ef5-456e-864d-093564ee1b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95f33b5455e4d2fafda8f48fe1d2428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:02:00Z,use_quota=True,user_id='0a36a1a728fe4f02b69ba3aab32a8d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63586d27-48a0-41b8-b9fb-e2842768de99),volume_type_id=63586d27-48a0-41b8-b9fb-e2842768de99)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Creating volume 5c1ef9a1-7ef5-456e-864d-093564ee1b1e {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:02:00 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5c1ef9a1-7ef5-456e-864d-093564ee1b1e 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:00 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5c1ef9a1-7ef5-456e-864d-093564ee1b1e 1073741824 Jul 14 13:02:00 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:00 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_fc5jpccldevstack@QuobyteHD Jul 14 13:02:00 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:00 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_fc5jpccldevstack@QuobyteHD" returned: 0 in 0.540s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:00 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5c1ef9a1-7ef5-456e-864d-093564ee1b1e 1073741824" returned: 0 in 0.511s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5c1ef9a1-7ef5-456e-864d-093564ee1b1e {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:00 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5c1ef9a1-7ef5-456e-864d-093564ee1b1e Jul 14 13:02:00 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:00 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5c1ef9a1-7ef5-456e-864d-093564ee1b1e" returned: 0 in 0.300s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.454s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1124866385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f69bd33f44de4ee2ad1e7fdded45e9ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:01:57Z,use_quota=True,user_id='2860f19f0cab4c4aa5d6c88f3d594745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Creating volume f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:02:00 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ca7593-0452-4b99-9e90-35a2436a4cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c1ef9a1-7ef5-456e-864d-093564ee1b1e', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1390223-5515-4e76-a8fe-847df6b7d656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:00 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Volume volume-5c1ef9a1-7ef5-456e-864d-093564ee1b1e (5c1ef9a1-7ef5-456e-864d-093564ee1b1e): created successfully Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1390223-5515-4e76-a8fe-847df6b7d656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:00 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 1073741824 Jul 14 13:02:00 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Flow 'volume_create_manager' (d2625767-d4e3-401f-92ae-8a0de1601b90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:02:00 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-99730ab6-89e9-4bf6-b859-1c46427ab806 tempest-VolumeTypesAccessTest-460095467 None] Created volume successfully. Jul 14 13:02:01 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 1073741824" returned: 0 in 0.629s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:01 devstack sudo[94721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 Jul 14 13:02:01 devstack sudo[94721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:01 devstack sudo[94721]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5" returned: 0 in 0.281s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:02:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:01 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Attempting download of 33abf4a9-ef06-4448-a45c-b53dca509874 ((None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}])) to volume f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5. {{(pid=86977) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 13:02:01 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4b593d-745d-490f-875e-a86461c4de4d]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_efg23jn3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5a7d7892-feda-4720-a90a-0c44b7f3cc92 tempest-VolumeTypesAccessTest-460095467 None] Acquiring lock "cinder-5c1ef9a1-7ef5-456e-864d-093564ee1b1e-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5a7d7892-feda-4720-a90a-0c44b7f3cc92 tempest-VolumeTypesAccessTest-460095467 None] Lock "cinder-5c1ef9a1-7ef5-456e-864d-093564ee1b1e-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:02 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_efg23jn3 Jul 14 13:02:02 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5a7d7892-feda-4720-a90a-0c44b7f3cc92 tempest-VolumeTypesAccessTest-460095467 None] Acquiring lock "cinder-quobyte-5c1ef9a1-7ef5-456e-864d-093564ee1b1e" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5a7d7892-feda-4720-a90a-0c44b7f3cc92 tempest-VolumeTypesAccessTest-460095467 None] Lock "cinder-quobyte-5c1ef9a1-7ef5-456e-864d-093564ee1b1e" acquired by "delete_volume" :: waited 0.043s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:02 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be3f856-db9a-417a-81e7-1fea13d17841]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5a7d7892-feda-4720-a90a-0c44b7f3cc92 tempest-VolumeTypesAccessTest-460095467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5c1ef9a1-7ef5-456e-864d-093564ee1b1e {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:02 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_efg23jn3" returned: 0 in 0.876s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_efg23jn3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:02 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5c1ef9a1-7ef5-456e-864d-093564ee1b1e Jul 14 13:02:02 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:03 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_efg23jn3 Jul 14 13:02:03 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:03 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5a7d7892-feda-4720-a90a-0c44b7f3cc92 tempest-VolumeTypesAccessTest-460095467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5c1ef9a1-7ef5-456e-864d-093564ee1b1e" returned: 0 in 0.838s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5a7d7892-feda-4720-a90a-0c44b7f3cc92 tempest-VolumeTypesAccessTest-460095467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5c1ef9a1-7ef5-456e-864d-093564ee1b1e {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:03 devstack sudo[94822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5c1ef9a1-7ef5-456e-864d-093564ee1b1e Jul 14 13:02:03 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:03 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_efg23jn3" returned: 1 in 0.687s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_efg23jn3' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:02:03 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[1083514f-65b9-4e1c-879c-95f2b39fdb54]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_fc5jpccldevstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:03 devstack sudo[94824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_fc5jpccldevstack@QuobyteHD Jul 14 13:02:03 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:03 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5a7d7892-feda-4720-a90a-0c44b7f3cc92 tempest-VolumeTypesAccessTest-460095467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5c1ef9a1-7ef5-456e-864d-093564ee1b1e" returned: 0 in 0.353s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5a7d7892-feda-4720-a90a-0c44b7f3cc92 tempest-VolumeTypesAccessTest-460095467 None] Lock "cinder-quobyte-5c1ef9a1-7ef5-456e-864d-093564ee1b1e" released by "delete_volume" :: held 1.285s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:03 devstack cinder-volume[86977]: WARNING cinder.quota [None req-5a7d7892-feda-4720-a90a-0c44b7f3cc92 tempest-VolumeTypesAccessTest-460095467 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-37922598 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-37922598, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:02:03 devstack cinder-volume[86977]: WARNING cinder.quota [None req-5a7d7892-feda-4720-a90a-0c44b7f3cc92 tempest-VolumeTypesAccessTest-460095467 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-37922598 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-37922598, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:02:03 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-5a7d7892-feda-4720-a90a-0c44b7f3cc92 tempest-VolumeTypesAccessTest-460095467 None] Created reservations ['8b415155-1df1-41da-a04b-3857c3d9dcad', '1504a1a7-1086-4541-a051-724574b30ec7', 'bdf9cda5-acbd-4062-b694-3878fe7753bd', '59fb58a8-4c1d-4cae-a7bc-251fe5c95389'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:02:04 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_fc5jpccldevstack@QuobyteHD" returned: 0 in 0.492s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:04 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] 33abf4a9-ef06-4448-a45c-b53dca509874 was qcow2, converting to raw {{(pid=86977) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1139}} Jul 14 13:02:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_fc5jpccldevstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5a7d7892-feda-4720-a90a-0c44b7f3cc92 tempest-VolumeTypesAccessTest-460095467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5a7d7892-feda-4720-a90a-0c44b7f3cc92 tempest-VolumeTypesAccessTest-460095467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5a7d7892-feda-4720-a90a-0c44b7f3cc92 tempest-VolumeTypesAccessTest-460095467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:02:04 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_fc5jpccldevstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 Jul 14 13:02:04 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5a7d7892-feda-4720-a90a-0c44b7f3cc92 tempest-VolumeTypesAccessTest-460095467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:02:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5a7d7892-feda-4720-a90a-0c44b7f3cc92 tempest-VolumeTypesAccessTest-460095467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5a7d7892-feda-4720-a90a-0c44b7f3cc92 tempest-VolumeTypesAccessTest-460095467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:04 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:02:04 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:04 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5a7d7892-feda-4720-a90a-0c44b7f3cc92 tempest-VolumeTypesAccessTest-460095467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.272s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:04 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-5a7d7892-feda-4720-a90a-0c44b7f3cc92 tempest-VolumeTypesAccessTest-460095467 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:02:04 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-5a7d7892-feda-4720-a90a-0c44b7f3cc92 tempest-VolumeTypesAccessTest-460095467 None] Deleted volume successfully. Jul 14 13:02:04 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5a7d7892-feda-4720-a90a-0c44b7f3cc92 tempest-VolumeTypesAccessTest-460095467 None] Lock "cinder-5c1ef9a1-7ef5-456e-864d-093564ee1b1e-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:06 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_fc5jpccldevstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5" returned: 0 in 2.153s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:06 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_fc5jpccldevstack@QuobyteHD, size 112.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:02:06 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Converted 112.00 MB image at 51.99 MB/s Jul 14 13:02:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:06 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 1G Jul 14 13:02:06 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:06 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 1G" returned: 0 in 0.532s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:06 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae45ec19-d41e-48b2-bfd9-796ce4395ed7]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:07 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 Jul 14 13:02:07 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:07 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5" returned: 0 in 0.627s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:07 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 Jul 14 13:02:07 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:07 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5" returned: 1 in 0.507s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:02:07 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Downloaded image 33abf4a9-ef06-4448-a45c-b53dca509874 ((None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}])) to volume f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 successfully. {{(pid=86977) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 13:02:07 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Temporary image 33abf4a9-ef06-4448-a45c-b53dca509874 for user 2860f19f0cab4c4aa5d6c88f3d594745 is deleted. {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:1454}} Jul 14 13:02:07 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Marking volume f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 as bootable. {{(pid=86977) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 13:02:07 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Copying metadata from image 33abf4a9-ef06-4448-a45c-b53dca509874 to f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5. {{(pid=86977) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 13:02:07 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Creating volume glance metadata for volume f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 backed by image 33abf4a9-ef06-4448-a45c-b53dca509874 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86977) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 13:02:08 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30ddf03-b8de-4c68-ac88-c8766b72bbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5', 'volume_size': 1, 'image_id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cc8c62448314c45912011edd3ae5374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'created_at': datetime.datetime(2026, 7, 14, 10, 49, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 10, 49, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33abf4a9-ef06-4448-a45c-b53dca509874/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:08 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c511a55-5e5b-476d-9dbf-b77647a5ff91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:08 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Volume volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 (f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5): created successfully Jul 14 13:02:08 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c511a55-5e5b-476d-9dbf-b77647a5ff91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:08 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Flow 'volume_create_manager' (be406401-7855-4e97-aa10-a824e0d0364f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:02:08 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-ce73e596-5157-4760-a596-61051ba550a2 tempest-VolumesImageMetadata-1560227399 None] Created volume successfully. Jul 14 13:02:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] Acquiring lock "cinder-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] Lock "cinder-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] Acquiring lock "cinder-quobyte-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] Lock "cinder-quobyte-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5" acquired by "delete_volume" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:09 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e5d44e-3d9d-49fc-b04e-1976736df650]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:09 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 Jul 14 13:02:09 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:10 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5" returned: 0 in 0.494s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:10 devstack sudo[94868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 Jul 14 13:02:10 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:10 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5" returned: 1 in 0.416s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:02:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:10 devstack sudo[94873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5 Jul 14 13:02:10 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:10 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5" returned: 0 in 0.350s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] Lock "cinder-quobyte-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5" released by "delete_volume" :: held 1.379s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:11 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] Created reservations ['d4e099df-4363-4f56-8777-7b10643d0c6c', 'd62b33d8-23c8-47f4-8058-099846bc43f2', '34b69a93-4de1-4009-b106-7c9ae12c3a52', '6311181a-3596-4a31-9f48-6f2848dce3fb'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:02:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:02:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:02:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:11 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:02:11 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:11 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.314s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:11 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:02:11 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] Deleted volume successfully. Jul 14 13:02:11 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-05ce00f0-dd37-40e3-8b92-10816b1ecbd0 tempest-VolumesImageMetadata-1560227399 None] Lock "cinder-f0f3aedb-4f7a-499b-82aa-38fb2f6f33e5-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:15 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:02:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Flow 'volume_create_manager' (70f6dc0f-09d1-467e-ba6a-0f02eadf5798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:02:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddd3e9c-cab8-4cfe-a810-40ca6ed2c369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddd3e9c-cab8-4cfe-a810-40ca6ed2c369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2113596893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8714d82-1ff7-41a6-a16d-dbd011729c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a776181d6140d6883ac80cb97795ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:02:15Z,use_quota=True,user_id='be67f5f61375488fa2a986d7c99e25bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927e199d-df89-4fa4-ba59-df8223f8950f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927e199d-df89-4fa4-ba59-df8223f8950f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ada03c-daf1-414b-a743-ca682b177b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ada03c-daf1-414b-a743-ca682b177b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8714d82-1ff7-41a6-a16d-dbd011729c34', 'volume_name': 'volume-b8714d82-1ff7-41a6-a16d-dbd011729c34', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5383ac-8e91-4c5a-ada7-77327020dd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5383ac-8e91-4c5a-ada7-77327020dd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9365e8-4f5f-49dd-becf-072f3af9ec32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:15 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Volume b8714d82-1ff7-41a6-a16d-dbd011729c34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8714d82-1ff7-41a6-a16d-dbd011729c34', 'volume_size': 1} Jul 14 13:02:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2113596893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8714d82-1ff7-41a6-a16d-dbd011729c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a776181d6140d6883ac80cb97795ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:02:15Z,use_quota=True,user_id='be67f5f61375488fa2a986d7c99e25bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:02:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Creating volume b8714d82-1ff7-41a6-a16d-dbd011729c34 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:02:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:02:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:02:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:02:15 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:02:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b8714d82-1ff7-41a6-a16d-dbd011729c34 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:15 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b8714d82-1ff7-41a6-a16d-dbd011729c34 1073741824 Jul 14 13:02:15 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:02:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 28 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 13:02:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 13:02:16 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b8714d82-1ff7-41a6-a16d-dbd011729c34 1073741824" returned: 0 in 0.895s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b8714d82-1ff7-41a6-a16d-dbd011729c34 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:16 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b8714d82-1ff7-41a6-a16d-dbd011729c34 Jul 14 13:02:16 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:17 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b8714d82-1ff7-41a6-a16d-dbd011729c34" returned: 0 in 0.507s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9365e8-4f5f-49dd-becf-072f3af9ec32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8714d82-1ff7-41a6-a16d-dbd011729c34', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68391023-3c9e-4ac0-98cd-6bf94c497d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:17 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Volume volume-b8714d82-1ff7-41a6-a16d-dbd011729c34 (b8714d82-1ff7-41a6-a16d-dbd011729c34): created successfully Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68391023-3c9e-4ac0-98cd-6bf94c497d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Flow 'volume_create_manager' (70f6dc0f-09d1-467e-ba6a-0f02eadf5798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:02:17 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-383409ca-a5e9-48df-b103-e7c48d8706bc tempest-AttachVolumeNegativeTest-115818279 None] Created volume successfully. Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Flow 'volume_create_manager' (25440af4-8bab-4e4f-8ad7-e3e96d74f4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792fb268-4d47-420f-bf97-6f32c24615f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792fb268-4d47-420f-bf97-6f32c24615f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1222310781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726d773e-7420-4729-b769-50342c1d620e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66dd8ddd5ce94a6782ca91d898619903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:02:17Z,use_quota=True,user_id='a1482baa76104cd18e6ba9189e9a2aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af69e57b-546d-4d1f-bd7a-3b4bde5e5c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af69e57b-546d-4d1f-bd7a-3b4bde5e5c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91bb915f-cbb5-41d6-be73-f7f2578c4439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91bb915f-cbb5-41d6-be73-f7f2578c4439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '726d773e-7420-4729-b769-50342c1d620e', 'volume_name': 'volume-726d773e-7420-4729-b769-50342c1d620e', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (204b9a28-f8d5-4187-868a-8370e76ba334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (204b9a28-f8d5-4187-868a-8370e76ba334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ee58d9-170b-4b2d-9694-6d7715c00439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:17 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Volume 726d773e-7420-4729-b769-50342c1d620e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-726d773e-7420-4729-b769-50342c1d620e', 'volume_size': 1} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1222310781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726d773e-7420-4729-b769-50342c1d620e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66dd8ddd5ce94a6782ca91d898619903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:02:17Z,use_quota=True,user_id='a1482baa76104cd18e6ba9189e9a2aac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Creating volume 726d773e-7420-4729-b769-50342c1d620e {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:02:17 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:02:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-726d773e-7420-4729-b769-50342c1d620e 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:17 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-726d773e-7420-4729-b769-50342c1d620e 1073741824 Jul 14 13:02:17 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:18 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-726d773e-7420-4729-b769-50342c1d620e 1073741824" returned: 0 in 0.459s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-726d773e-7420-4729-b769-50342c1d620e {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:18 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-726d773e-7420-4729-b769-50342c1d620e Jul 14 13:02:18 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:18 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-726d773e-7420-4729-b769-50342c1d620e" returned: 0 in 0.305s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:02:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ee58d9-170b-4b2d-9694-6d7715c00439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-726d773e-7420-4729-b769-50342c1d620e', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e911fac1-1e85-456e-a66f-6f9d51533f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:18 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Volume volume-726d773e-7420-4729-b769-50342c1d620e (726d773e-7420-4729-b769-50342c1d620e): created successfully Jul 14 13:02:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e911fac1-1e85-456e-a66f-6f9d51533f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Flow 'volume_create_manager' (25440af4-8bab-4e4f-8ad7-e3e96d74f4aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:02:18 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-40f0147b-c17f-4b34-9051-78167343c825 tempest-AbsoluteLimitsTests-655815924 None] Created volume successfully. Jul 14 13:02:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-87335d71-0e20-4599-b210-77a7b76943ed req-98c46fdb-0e0f-4a43-b0b3-231447d40fb2 tempest-AttachVolumeNegativeTest-115818279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-87335d71-0e20-4599-b210-77a7b76943ed req-98c46fdb-0e0f-4a43-b0b3-231447d40fb2 tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:18 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55e5bc0-421c-4557-aa91-4b0c231a99e4]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-87335d71-0e20-4599-b210-77a7b76943ed req-98c46fdb-0e0f-4a43-b0b3-231447d40fb2 tempest-AttachVolumeNegativeTest-115818279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b8714d82-1ff7-41a6-a16d-dbd011729c34 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:18 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b8714d82-1ff7-41a6-a16d-dbd011729c34 Jul 14 13:02:18 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:19 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-87335d71-0e20-4599-b210-77a7b76943ed req-98c46fdb-0e0f-4a43-b0b3-231447d40fb2 tempest-AttachVolumeNegativeTest-115818279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b8714d82-1ff7-41a6-a16d-dbd011729c34" returned: 0 in 0.382s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-87335d71-0e20-4599-b210-77a7b76943ed req-98c46fdb-0e0f-4a43-b0b3-231447d40fb2 tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.399s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-87335d71-0e20-4599-b210-77a7b76943ed req-98c46fdb-0e0f-4a43-b0b3-231447d40fb2 tempest-AttachVolumeNegativeTest-115818279 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1', 'name': 'volume-b8714d82-1ff7-41a6-a16d-dbd011729c34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f6eb40a8-4728-41d8-9838-bb119a174182', 'enforce_multipath': True} {{(pid=86977) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 13:02:19 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-87335d71-0e20-4599-b210-77a7b76943ed req-98c46fdb-0e0f-4a43-b0b3-231447d40fb2 tempest-AttachVolumeNegativeTest-115818279 None] attachment_update completed successfully. Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Flow 'volume_create_manager' (feab6b50-4341-4725-91aa-26261ed22f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e874655c-84cf-4a71-917c-a54b5d154e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e874655c-84cf-4a71-917c-a54b5d154e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-677653353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11274fb-1306-473a-b358-74ce56ee9cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e97c0c1318a406eb0112ab7d70af8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:02:19Z,use_quota=True,user_id='2b775a44a45346ac9fc8a14edb64396b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7016a94-fe56-4b46-8acc-fe041100fc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7016a94-fe56-4b46-8acc-fe041100fc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa930ab-b3b8-4ddf-b44a-89d345becfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa930ab-b3b8-4ddf-b44a-89d345becfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e11274fb-1306-473a-b358-74ce56ee9cd7', 'volume_name': 'volume-e11274fb-1306-473a-b358-74ce56ee9cd7', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6b777b-f890-4107-b2ae-9f79198942d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6b777b-f890-4107-b2ae-9f79198942d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7168ab91-fd83-4c46-86bb-94b298edabe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:19 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Volume e11274fb-1306-473a-b358-74ce56ee9cd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e11274fb-1306-473a-b358-74ce56ee9cd7', 'volume_size': 1} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-677653353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11274fb-1306-473a-b358-74ce56ee9cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e97c0c1318a406eb0112ab7d70af8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:02:19Z,use_quota=True,user_id='2b775a44a45346ac9fc8a14edb64396b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Creating volume e11274fb-1306-473a-b358-74ce56ee9cd7 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:02:19 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:19 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7 1073741824 Jul 14 13:02:19 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6636bb94-cb26-485e-af8f-4833a81caac0 tempest-AbsoluteLimitsTests-655815924 None] Acquiring lock "cinder-726d773e-7420-4729-b769-50342c1d620e-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6636bb94-cb26-485e-af8f-4833a81caac0 tempest-AbsoluteLimitsTests-655815924 None] Lock "cinder-726d773e-7420-4729-b769-50342c1d620e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6636bb94-cb26-485e-af8f-4833a81caac0 tempest-AbsoluteLimitsTests-655815924 None] Acquiring lock "cinder-quobyte-726d773e-7420-4729-b769-50342c1d620e" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6636bb94-cb26-485e-af8f-4833a81caac0 tempest-AbsoluteLimitsTests-655815924 None] Lock "cinder-quobyte-726d773e-7420-4729-b769-50342c1d620e" acquired by "delete_volume" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdac309-8dbc-4145-bb92-b48e7032b7ee]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6636bb94-cb26-485e-af8f-4833a81caac0 tempest-AbsoluteLimitsTests-655815924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-726d773e-7420-4729-b769-50342c1d620e {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:19 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-726d773e-7420-4729-b769-50342c1d620e Jul 14 13:02:19 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:19 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7 1073741824" returned: 0 in 0.543s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:20 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7 Jul 14 13:02:20 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:20 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6636bb94-cb26-485e-af8f-4833a81caac0 tempest-AbsoluteLimitsTests-655815924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-726d773e-7420-4729-b769-50342c1d620e" returned: 0 in 0.436s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6636bb94-cb26-485e-af8f-4833a81caac0 tempest-AbsoluteLimitsTests-655815924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-726d773e-7420-4729-b769-50342c1d620e {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:20 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7" returned: 0 in 0.285s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:02:20 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-726d773e-7420-4729-b769-50342c1d620e Jul 14 13:02:20 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7168ab91-fd83-4c46-86bb-94b298edabe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e11274fb-1306-473a-b358-74ce56ee9cd7', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff8cb2d-2413-42c9-92e3-703faa50964c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:20 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Volume volume-e11274fb-1306-473a-b358-74ce56ee9cd7 (e11274fb-1306-473a-b358-74ce56ee9cd7): created successfully Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff8cb2d-2413-42c9-92e3-703faa50964c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Flow 'volume_create_manager' (feab6b50-4341-4725-91aa-26261ed22f89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:02:20 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-a8a10e77-e3fa-435e-b488-5717c3c1a03d tempest-SnapshotMetadataTestJSON-237188989 None] Created volume successfully. Jul 14 13:02:20 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6636bb94-cb26-485e-af8f-4833a81caac0 tempest-AbsoluteLimitsTests-655815924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-726d773e-7420-4729-b769-50342c1d620e" returned: 0 in 0.254s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6636bb94-cb26-485e-af8f-4833a81caac0 tempest-AbsoluteLimitsTests-655815924 None] Lock "cinder-quobyte-726d773e-7420-4729-b769-50342c1d620e" released by "delete_volume" :: held 0.735s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-6636bb94-cb26-485e-af8f-4833a81caac0 tempest-AbsoluteLimitsTests-655815924 None] Created reservations ['ad0719e3-30ee-43af-91a0-b579cdbe4d30', '60990d8e-8e80-47dd-986f-fd56c9edcce0', '866b9678-4255-4aea-a41a-04d7c6f6b3f7', '5308a09e-5484-4f6b-8310-f8b7785f338c'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6636bb94-cb26-485e-af8f-4833a81caac0 tempest-AbsoluteLimitsTests-655815924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6636bb94-cb26-485e-af8f-4833a81caac0 tempest-AbsoluteLimitsTests-655815924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6636bb94-cb26-485e-af8f-4833a81caac0 tempest-AbsoluteLimitsTests-655815924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6636bb94-cb26-485e-af8f-4833a81caac0 tempest-AbsoluteLimitsTests-655815924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6636bb94-cb26-485e-af8f-4833a81caac0 tempest-AbsoluteLimitsTests-655815924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6636bb94-cb26-485e-af8f-4833a81caac0 tempest-AbsoluteLimitsTests-655815924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:20 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:02:20 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:20 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6636bb94-cb26-485e-af8f-4833a81caac0 tempest-AbsoluteLimitsTests-655815924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.247s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-6636bb94-cb26-485e-af8f-4833a81caac0 tempest-AbsoluteLimitsTests-655815924 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:02:20 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-6636bb94-cb26-485e-af8f-4833a81caac0 tempest-AbsoluteLimitsTests-655815924 None] Deleted volume successfully. Jul 14 13:02:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6636bb94-cb26-485e-af8f-4833a81caac0 tempest-AbsoluteLimitsTests-655815924 None] Lock "cinder-726d773e-7420-4729-b769-50342c1d620e-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:21 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-e566fd71-a62f-4a74-96d7-9b44f14c1311 req-d06a007a-c7a4-40d9-babb-95b255184073 tempest-AttachVolumeNegativeTest-115818279 None] Terminate volume connection completed successfully. Jul 14 13:02:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-e566fd71-a62f-4a74-96d7-9b44f14c1311 req-d06a007a-c7a4-40d9-babb-95b255184073 tempest-AttachVolumeNegativeTest-115818279 None] Deleting attachment f6eb40a8-4728-41d8-9838-bb119a174182. {{(pid=86977) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 13:02:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e5f6feb8-a120-4bbf-9ce3-3aa78d54fd59 tempest-SnapshotMetadataTestJSON-237188989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e5f6feb8-a120-4bbf-9ce3-3aa78d54fd59 tempest-SnapshotMetadataTestJSON-237188989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-e5f6feb8-a120-4bbf-9ce3-3aa78d54fd59 tempest-SnapshotMetadataTestJSON-237188989 None] Creating offline snapshot 226ea4e8-aa73-4176-89cc-39561da42eef of volume e11274fb-1306-473a-b358-74ce56ee9cd7 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:02:21 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[3029cc3a-ced0-46ce-99cd-f79368a97f22]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e5f6feb8-a120-4bbf-9ce3-3aa78d54fd59 tempest-SnapshotMetadataTestJSON-237188989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:21 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7 Jul 14 13:02:21 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:22 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e5f6feb8-a120-4bbf-9ce3-3aa78d54fd59 tempest-SnapshotMetadataTestJSON-237188989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7" returned: 0 in 0.395s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e5f6feb8-a120-4bbf-9ce3-3aa78d54fd59 tempest-SnapshotMetadataTestJSON-237188989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.226ea4e8-aa73-4176-89cc-39561da42eef 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:22 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.226ea4e8-aa73-4176-89cc-39561da42eef 1G Jul 14 13:02:22 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:22 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e5f6feb8-a120-4bbf-9ce3-3aa78d54fd59 tempest-SnapshotMetadataTestJSON-237188989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.226ea4e8-aa73-4176-89cc-39561da42eef 1G" returned: 0 in 0.534s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e5f6feb8-a120-4bbf-9ce3-3aa78d54fd59 tempest-SnapshotMetadataTestJSON-237188989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11274fb-1306-473a-b358-74ce56ee9cd7 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.226ea4e8-aa73-4176-89cc-39561da42eef {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:22 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11274fb-1306-473a-b358-74ce56ee9cd7 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.226ea4e8-aa73-4176-89cc-39561da42eef Jul 14 13:02:22 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:23 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e5f6feb8-a120-4bbf-9ce3-3aa78d54fd59 tempest-SnapshotMetadataTestJSON-237188989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11274fb-1306-473a-b358-74ce56ee9cd7 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.226ea4e8-aa73-4176-89cc-39561da42eef" returned: 0 in 0.449s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:23 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-e5f6feb8-a120-4bbf-9ce3-3aa78d54fd59 tempest-SnapshotMetadataTestJSON-237188989 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.226ea4e8-aa73-4176-89cc-39561da42eef is being set with open permissions: ugo+rw Jul 14 13:02:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e5f6feb8-a120-4bbf-9ce3-3aa78d54fd59 tempest-SnapshotMetadataTestJSON-237188989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.226ea4e8-aa73-4176-89cc-39561da42eef {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:23 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.226ea4e8-aa73-4176-89cc-39561da42eef Jul 14 13:02:23 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:23 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e5f6feb8-a120-4bbf-9ce3-3aa78d54fd59 tempest-SnapshotMetadataTestJSON-237188989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.226ea4e8-aa73-4176-89cc-39561da42eef" returned: 0 in 0.325s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e5f6feb8-a120-4bbf-9ce3-3aa78d54fd59 tempest-SnapshotMetadataTestJSON-237188989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:23 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.info Jul 14 13:02:23 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:23 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e5f6feb8-a120-4bbf-9ce3-3aa78d54fd59 tempest-SnapshotMetadataTestJSON-237188989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.info" returned: 0 in 0.363s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:23 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-e5f6feb8-a120-4bbf-9ce3-3aa78d54fd59 tempest-SnapshotMetadataTestJSON-237188989 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.info is being set with open permissions: ugo+rw Jul 14 13:02:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e5f6feb8-a120-4bbf-9ce3-3aa78d54fd59 tempest-SnapshotMetadataTestJSON-237188989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:23 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.info Jul 14 13:02:23 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:24 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e5f6feb8-a120-4bbf-9ce3-3aa78d54fd59 tempest-SnapshotMetadataTestJSON-237188989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.info" returned: 0 in 0.257s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e5f6feb8-a120-4bbf-9ce3-3aa78d54fd59 tempest-SnapshotMetadataTestJSON-237188989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.447s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:24 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e5f6feb8-a120-4bbf-9ce3-3aa78d54fd59 tempest-SnapshotMetadataTestJSON-237188989 None] Create snapshot completed successfully Jul 14 13:02:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6e296f59-baa7-4899-a8ad-7cc53cf3ea60 tempest-SnapshotMetadataTestJSON-237188989 None] Acquiring lock "cinder-226ea4e8-aa73-4176-89cc-39561da42eef-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6e296f59-baa7-4899-a8ad-7cc53cf3ea60 tempest-SnapshotMetadataTestJSON-237188989 None] Lock "cinder-226ea4e8-aa73-4176-89cc-39561da42eef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6e296f59-baa7-4899-a8ad-7cc53cf3ea60 tempest-SnapshotMetadataTestJSON-237188989 None] Acquiring lock "cinder-quobyte-e11274fb-1306-473a-b358-74ce56ee9cd7" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6e296f59-baa7-4899-a8ad-7cc53cf3ea60 tempest-SnapshotMetadataTestJSON-237188989 None] Lock "cinder-quobyte-e11274fb-1306-473a-b358-74ce56ee9cd7" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6e296f59-baa7-4899-a8ad-7cc53cf3ea60 tempest-SnapshotMetadataTestJSON-237188989 None] Acquiring lock "cinder-quobyte-226ea4e8-aa73-4176-89cc-39561da42eef" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6e296f59-baa7-4899-a8ad-7cc53cf3ea60 tempest-SnapshotMetadataTestJSON-237188989 None] Lock "cinder-quobyte-226ea4e8-aa73-4176-89cc-39561da42eef" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-6e296f59-baa7-4899-a8ad-7cc53cf3ea60 tempest-SnapshotMetadataTestJSON-237188989 None] Deleting offline snapshot 226ea4e8-aa73-4176-89cc-39561da42eef of volume e11274fb-1306-473a-b358-74ce56ee9cd7 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:02:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-6e296f59-baa7-4899-a8ad-7cc53cf3ea60 tempest-SnapshotMetadataTestJSON-237188989 None] snapshot_file for this snap is: volume-e11274fb-1306-473a-b358-74ce56ee9cd7.226ea4e8-aa73-4176-89cc-39561da42eef {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:02:25 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ad79f4-a752-47b1-ba26-142488ed973b]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6e296f59-baa7-4899-a8ad-7cc53cf3ea60 tempest-SnapshotMetadataTestJSON-237188989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.226ea4e8-aa73-4176-89cc-39561da42eef {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:26 devstack sudo[95434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.226ea4e8-aa73-4176-89cc-39561da42eef Jul 14 13:02:26 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:26 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6e296f59-baa7-4899-a8ad-7cc53cf3ea60 tempest-SnapshotMetadataTestJSON-237188989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.226ea4e8-aa73-4176-89cc-39561da42eef" returned: 0 in 0.453s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:26 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-6e296f59-baa7-4899-a8ad-7cc53cf3ea60 tempest-SnapshotMetadataTestJSON-237188989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e11274fb-1306-473a-b358-74ce56ee9cd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:02:26 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bf54b3-138a-4438-afc6-ea95198b4982]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6e296f59-baa7-4899-a8ad-7cc53cf3ea60 tempest-SnapshotMetadataTestJSON-237188989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:26 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7 Jul 14 13:02:26 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:26 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6e296f59-baa7-4899-a8ad-7cc53cf3ea60 tempest-SnapshotMetadataTestJSON-237188989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7" returned: 0 in 0.497s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6e296f59-baa7-4899-a8ad-7cc53cf3ea60 tempest-SnapshotMetadataTestJSON-237188989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.226ea4e8-aa73-4176-89cc-39561da42eef {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:26 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.226ea4e8-aa73-4176-89cc-39561da42eef Jul 14 13:02:26 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:27 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:02:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Flow 'volume_create_manager' (42b53548-10dd-4111-89b4-a38d25a4ddc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:02:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f4e609-ac98-4890-87d8-e16f62dcb921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f4e609-ac98-4890-87d8-e16f62dcb921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-311959834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=124c4ce4-0b1c-4c40-b461-79d8984fc451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c64962cf2ede45d586a6702fd9f74a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:02:27Z,use_quota=True,user_id='a7ae3927c245493a92c5bc8b91681c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b083ecb9-da34-4229-a1ce-a44c7636cffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b083ecb9-da34-4229-a1ce-a44c7636cffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd47f51-2219-4797-8667-ef1aa91f01d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:27 devstack cinder-volume[86977]: DEBUG cinder.image.glance [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Creating Keystone auth plugin from conf {{(pid=86977) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 13:02:27 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6e296f59-baa7-4899-a8ad-7cc53cf3ea60 tempest-SnapshotMetadataTestJSON-237188989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.226ea4e8-aa73-4176-89cc-39561da42eef" returned: 0 in 0.554s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6e296f59-baa7-4899-a8ad-7cc53cf3ea60 tempest-SnapshotMetadataTestJSON-237188989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.226ea4e8-aa73-4176-89cc-39561da42eef {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:27 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.226ea4e8-aa73-4176-89cc-39561da42eef Jul 14 13:02:27 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd47f51-2219-4797-8667-ef1aa91f01d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '124c4ce4-0b1c-4c40-b461-79d8984fc451', 'volume_name': 'volume-124c4ce4-0b1c-4c40-b461-79d8984fc451', 'volume_size': 1, 'image_id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cc8c62448314c45912011edd3ae5374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'created_at': datetime.datetime(2026, 7, 14, 10, 49, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 10, 49, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33abf4a9-ef06-4448-a45c-b53dca509874/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (142cd0e5-27f8-4613-9ebc-75473cbff06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (142cd0e5-27f8-4613-9ebc-75473cbff06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1886d79a-6358-4f33-ae63-b314213f5595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:27 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Volume 124c4ce4-0b1c-4c40-b461-79d8984fc451: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-124c4ce4-0b1c-4c40-b461-79d8984fc451', 'volume_size': 1, 'image_id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cc8c62448314c45912011edd3ae5374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'created_at': datetime.datetime(2026, 7, 14, 10, 49, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 10, 49, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33abf4a9-ef06-4448-a45c-b53dca509874/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 14 13:02:27 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Trying to clone 124c4ce4-0b1c-4c40-b461-79d8984fc451 from image 33abf4a9-ef06-4448-a45c-b53dca509874 at location (None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}]). {{(pid=86977) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 13:02:27 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6e296f59-baa7-4899-a8ad-7cc53cf3ea60 tempest-SnapshotMetadataTestJSON-237188989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7.226ea4e8-aa73-4176-89cc-39561da42eef" returned: 0 in 0.384s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6e296f59-baa7-4899-a8ad-7cc53cf3ea60 tempest-SnapshotMetadataTestJSON-237188989 None] Lock "cinder-quobyte-226ea4e8-aa73-4176-89cc-39561da42eef" released by "_delete_snapshot" :: held 2.086s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6e296f59-baa7-4899-a8ad-7cc53cf3ea60 tempest-SnapshotMetadataTestJSON-237188989 None] Lock "cinder-quobyte-e11274fb-1306-473a-b358-74ce56ee9cd7" released by "delete_snapshot" :: held 2.171s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Flow 'volume_create_manager' (13fca14a-862e-4060-902b-3f6b59a73e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32e7ab32-04b1-46ce-a855-f036eaf74ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32e7ab32-04b1-46ce-a855-f036eaf74ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1032673522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e3fcd4-5676-43ea-aecd-80042cefff9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4664ea974144fb486cc8b58cad7c1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:02:28Z,use_quota=True,user_id='b03a62ff5abb4d58b5189e4018998616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8771d02d-e511-410e-b34b-de22b65e65ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8771d02d-e511-410e-b34b-de22b65e65ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ced2560-a964-4f9b-ad95-70163a6739b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ced2560-a964-4f9b-ad95-70163a6739b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8e3fcd4-5676-43ea-aecd-80042cefff9a', 'volume_name': 'volume-d8e3fcd4-5676-43ea-aecd-80042cefff9a', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df011a4-4a35-4143-952e-b5da90740e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df011a4-4a35-4143-952e-b5da90740e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe42fa4-2096-47ae-99e4-a64e7435e04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:28 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Volume d8e3fcd4-5676-43ea-aecd-80042cefff9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8e3fcd4-5676-43ea-aecd-80042cefff9a', 'volume_size': 1} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1032673522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e3fcd4-5676-43ea-aecd-80042cefff9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4664ea974144fb486cc8b58cad7c1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:02:28Z,use_quota=True,user_id='b03a62ff5abb4d58b5189e4018998616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Creating volume d8e3fcd4-5676-43ea-aecd-80042cefff9a {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:02:28 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8e3fcd4-5676-43ea-aecd-80042cefff9a 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:28 devstack sudo[95456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8e3fcd4-5676-43ea-aecd-80042cefff9a 1073741824 Jul 14 13:02:28 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_cu_yjdkkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:751}} Jul 14 13:02:28 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Image download 20.69 MB at 20.69 MB/s Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-6e296f59-baa7-4899-a8ad-7cc53cf3ea60 tempest-SnapshotMetadataTestJSON-237188989 None] Created reservations ['1fca23cc-70d8-4afe-bf0c-d08a9d32890e', '541edc5e-acdd-433f-911a-55d69eff44ca', '71935c52-f3a8-44d2-a527-aa5379e494d0', '204b57f0-110e-4e8c-9c71-e574608f51cf'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[337a38fc-53d8-4161-abce-f766a0f48794]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_cu_yjdkkdevstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:28 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-6e296f59-baa7-4899-a8ad-7cc53cf3ea60 tempest-SnapshotMetadataTestJSON-237188989 None] Delete snapshot completed successfully. Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6e296f59-baa7-4899-a8ad-7cc53cf3ea60 tempest-SnapshotMetadataTestJSON-237188989 None] Lock "cinder-226ea4e8-aa73-4176-89cc-39561da42eef-delete_snapshot" released by "delete_snapshot" :: held 2.621s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:28 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_cu_yjdkkdevstack@QuobyteHD Jul 14 13:02:28 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:28 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8e3fcd4-5676-43ea-aecd-80042cefff9a 1073741824" returned: 0 in 0.481s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8e3fcd4-5676-43ea-aecd-80042cefff9a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:28 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8e3fcd4-5676-43ea-aecd-80042cefff9a Jul 14 13:02:28 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:28 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_cu_yjdkkdevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Temporary image 33abf4a9-ef06-4448-a45c-b53dca509874 is fetched for user a7ae3927c245493a92c5bc8b91681c01. {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:1450}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f15c3ff-9dde-466b-938b-e9bc9bd186d5]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_cu_yjdkkdevstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:28 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:28 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_cu_yjdkkdevstack@QuobyteHD Jul 14 13:02:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8e3fcd4-5676-43ea-aecd-80042cefff9a" returned: 0 in 0.320s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:29 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe42fa4-2096-47ae-99e4-a64e7435e04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8e3fcd4-5676-43ea-aecd-80042cefff9a', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0657bb3-9b02-4a07-895a-570c264542f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:29 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Volume volume-d8e3fcd4-5676-43ea-aecd-80042cefff9a (d8e3fcd4-5676-43ea-aecd-80042cefff9a): created successfully Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0657bb3-9b02-4a07-895a-570c264542f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Flow 'volume_create_manager' (13fca14a-862e-4060-902b-3f6b59a73e00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:02:29 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-305412b2-4c3a-4800-9a96-301376fb5cbf tempest-AttachVolumeShelveTestJSON-981611705 None] Created volume successfully. Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-449f526c-1910-4512-b7c4-eca9f4b8a542 tempest-SnapshotMetadataTestJSON-237188989 None] Acquiring lock "cinder-e11274fb-1306-473a-b358-74ce56ee9cd7-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-449f526c-1910-4512-b7c4-eca9f4b8a542 tempest-SnapshotMetadataTestJSON-237188989 None] Lock "cinder-e11274fb-1306-473a-b358-74ce56ee9cd7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-449f526c-1910-4512-b7c4-eca9f4b8a542 tempest-SnapshotMetadataTestJSON-237188989 None] Acquiring lock "cinder-quobyte-e11274fb-1306-473a-b358-74ce56ee9cd7" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-449f526c-1910-4512-b7c4-eca9f4b8a542 tempest-SnapshotMetadataTestJSON-237188989 None] Lock "cinder-quobyte-e11274fb-1306-473a-b358-74ce56ee9cd7" acquired by "delete_volume" :: waited 0.035s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:29 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[0960a410-955a-4951-8b9a-fd1584388e44]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-449f526c-1910-4512-b7c4-eca9f4b8a542 tempest-SnapshotMetadataTestJSON-237188989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_cu_yjdkkdevstack@QuobyteHD" returned: 0 in 0.610s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-311959834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=124c4ce4-0b1c-4c40-b461-79d8984fc451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c64962cf2ede45d586a6702fd9f74a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:02:27Z,use_quota=True,user_id='a7ae3927c245493a92c5bc8b91681c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Creating volume 124c4ce4-0b1c-4c40-b461-79d8984fc451 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:02:29 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:29 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 1073741824 Jul 14 13:02:29 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:29 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7 Jul 14 13:02:29 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:29 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-449f526c-1910-4512-b7c4-eca9f4b8a542 tempest-SnapshotMetadataTestJSON-237188989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7" returned: 0 in 0.415s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-449f526c-1910-4512-b7c4-eca9f4b8a542 tempest-SnapshotMetadataTestJSON-237188989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:29 devstack sudo[95486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7 Jul 14 13:02:29 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:29 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 1073741824" returned: 0 in 0.490s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:30 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 Jul 14 13:02:30 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:30 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-449f526c-1910-4512-b7c4-eca9f4b8a542 tempest-SnapshotMetadataTestJSON-237188989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e11274fb-1306-473a-b358-74ce56ee9cd7" returned: 0 in 0.294s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:30 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-449f526c-1910-4512-b7c4-eca9f4b8a542 tempest-SnapshotMetadataTestJSON-237188989 None] Lock "cinder-quobyte-e11274fb-1306-473a-b358-74ce56ee9cd7" released by "delete_volume" :: held 0.833s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:30 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-449f526c-1910-4512-b7c4-eca9f4b8a542 tempest-SnapshotMetadataTestJSON-237188989 None] Created reservations ['cf5351b1-4b08-43eb-9b56-6105184c4471', '7e88e683-a134-4bec-acfe-adb05b00ac36', '0fddedba-9af7-41e3-a4ef-9ffb2538a7ef', 'e9567f1b-be52-4007-8ade-d6baeb3a89cc'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:02:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-449f526c-1910-4512-b7c4-eca9f4b8a542 tempest-SnapshotMetadataTestJSON-237188989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-449f526c-1910-4512-b7c4-eca9f4b8a542 tempest-SnapshotMetadataTestJSON-237188989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-449f526c-1910-4512-b7c4-eca9f4b8a542 tempest-SnapshotMetadataTestJSON-237188989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:02:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-449f526c-1910-4512-b7c4-eca9f4b8a542 tempest-SnapshotMetadataTestJSON-237188989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:02:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-449f526c-1910-4512-b7c4-eca9f4b8a542 tempest-SnapshotMetadataTestJSON-237188989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-449f526c-1910-4512-b7c4-eca9f4b8a542 tempest-SnapshotMetadataTestJSON-237188989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:30 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451" returned: 0 in 0.462s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:02:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:30 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:02:30 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:30 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Attempting download of 33abf4a9-ef06-4448-a45c-b53dca509874 ((None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}])) to volume 124c4ce4-0b1c-4c40-b461-79d8984fc451. {{(pid=86977) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 13:02:30 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3802604-7dae-4c41-b6c3-6b4d85d86a62]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_8dbad2uj {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:30 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-449f526c-1910-4512-b7c4-eca9f4b8a542 tempest-SnapshotMetadataTestJSON-237188989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.289s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:30 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-449f526c-1910-4512-b7c4-eca9f4b8a542 tempest-SnapshotMetadataTestJSON-237188989 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:02:30 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-449f526c-1910-4512-b7c4-eca9f4b8a542 tempest-SnapshotMetadataTestJSON-237188989 None] Deleted volume successfully. Jul 14 13:02:30 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-449f526c-1910-4512-b7c4-eca9f4b8a542 tempest-SnapshotMetadataTestJSON-237188989 None] Lock "cinder-e11274fb-1306-473a-b358-74ce56ee9cd7-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:30 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_8dbad2uj Jul 14 13:02:30 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:31 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_8dbad2uj" returned: 0 in 0.401s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_8dbad2uj {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:31 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_8dbad2uj Jul 14 13:02:31 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:31 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_8dbad2uj" returned: 1 in 0.469s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_8dbad2uj' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:02:31 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea3867f-18d7-47a8-900d-5eaf0de48d23]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_cu_yjdkkdevstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:31 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_cu_yjdkkdevstack@QuobyteHD Jul 14 13:02:31 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:31 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_cu_yjdkkdevstack@QuobyteHD" returned: 0 in 0.505s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:32 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] 33abf4a9-ef06-4448-a45c-b53dca509874 was qcow2, converting to raw {{(pid=86977) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1139}} Jul 14 13:02:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_cu_yjdkkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:32 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_cu_yjdkkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 Jul 14 13:02:32 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:34 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_cu_yjdkkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451" returned: 0 in 2.271s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:34 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_cu_yjdkkdevstack@QuobyteHD, size 112.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:02:34 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Converted 112.00 MB image at 49.21 MB/s Jul 14 13:02:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:34 devstack sudo[95548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 1G Jul 14 13:02:34 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:34 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:02:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Flow 'volume_create_manager' (9f18a133-197c-4ead-b7f4-ee723295cfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:02:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133cb8df-38ef-4d85-affb-260d6bb16507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:34 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133cb8df-38ef-4d85-affb-260d6bb16507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-862740877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9870b5282804c3786acad3cf6f9689c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:02:35Z,use_quota=True,user_id='7c4d9308f0904b15ab0e85f3385d7e37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d63309f-a528-4fa4-bc5a-357581f01d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d63309f-a528-4fa4-bc5a-357581f01d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52025c41-ed6d-41e9-8edb-c0ff3960a0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52025c41-ed6d-41e9-8edb-c0ff3960a0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471', 'volume_name': 'volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced08c86-5030-40c2-aa0e-b0eec0f6172d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced08c86-5030-40c2-aa0e-b0eec0f6172d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd71783-08be-4f52-9bea-bb6dc3ea34f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:35 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Volume 6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471', 'volume_size': 1} Jul 14 13:02:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-862740877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9870b5282804c3786acad3cf6f9689c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:02:35Z,use_quota=True,user_id='7c4d9308f0904b15ab0e85f3385d7e37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:02:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Creating volume 6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:02:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:02:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:02:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:02:35 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:02:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 1G" returned: 0 in 0.754s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:35 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471 1073741824 Jul 14 13:02:35 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:35 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d11a40b-59c4-4839-a54e-a80825b23bc2]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:35 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 Jul 14 13:02:35 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:35 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451" returned: 0 in 0.493s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:35 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471 1073741824" returned: 0 in 0.603s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:35 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471 Jul 14 13:02:35 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:35 devstack sudo[95569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 Jul 14 13:02:35 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:35 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471" returned: 0 in 0.319s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:02:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd71783-08be-4f52-9bea-bb6dc3ea34f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec893665-e87c-499c-bbcd-1c036cbb163e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:36 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Volume volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471 (6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471): created successfully Jul 14 13:02:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec893665-e87c-499c-bbcd-1c036cbb163e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Flow 'volume_create_manager' (9f18a133-197c-4ead-b7f4-ee723295cfe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:02:36 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-3a7c7040-59bc-4c55-a468-93f7301648f5 tempest-VolumesDeleteCascade-1393361046 None] Created volume successfully. Jul 14 13:02:36 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451" returned: 1 in 0.489s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:02:36 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Downloaded image 33abf4a9-ef06-4448-a45c-b53dca509874 ((None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}])) to volume 124c4ce4-0b1c-4c40-b461-79d8984fc451 successfully. {{(pid=86977) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 13:02:36 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Temporary image 33abf4a9-ef06-4448-a45c-b53dca509874 for user a7ae3927c245493a92c5bc8b91681c01 is deleted. {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:1454}} Jul 14 13:02:36 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Marking volume 124c4ce4-0b1c-4c40-b461-79d8984fc451 as bootable. {{(pid=86977) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 13:02:36 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Copying metadata from image 33abf4a9-ef06-4448-a45c-b53dca509874 to 124c4ce4-0b1c-4c40-b461-79d8984fc451. {{(pid=86977) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 13:02:36 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Creating volume glance metadata for volume 124c4ce4-0b1c-4c40-b461-79d8984fc451 backed by image 33abf4a9-ef06-4448-a45c-b53dca509874 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86977) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 13:02:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1886d79a-6358-4f33-ae63-b314213f5595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-124c4ce4-0b1c-4c40-b461-79d8984fc451', 'volume_size': 1, 'image_id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cc8c62448314c45912011edd3ae5374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'created_at': datetime.datetime(2026, 7, 14, 10, 49, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 10, 49, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33abf4a9-ef06-4448-a45c-b53dca509874/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5901aa-0533-47bb-8caf-d62e1151c3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:36 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Volume volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 (124c4ce4-0b1c-4c40-b461-79d8984fc451): created successfully Jul 14 13:02:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5901aa-0533-47bb-8caf-d62e1151c3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Flow 'volume_create_manager' (42b53548-10dd-4111-89b4-a38d25a4ddc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:02:36 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-f1953163-e196-4a2b-a672-db20b4300e33 tempest-VolumesExtendTest-331170324 None] Created volume successfully. Jul 14 13:02:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-64b157cc-af03-4f3f-b455-64abd64ec56a tempest-VolumesExtendTest-331170324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-64b157cc-af03-4f3f-b455-64abd64ec56a tempest-VolumesExtendTest-331170324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:37 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f84011b-412b-4873-a12d-0e127fe1642e]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-64b157cc-af03-4f3f-b455-64abd64ec56a tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4faf8e8f-267d-452e-9518-c58754496a4c tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:37 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 Jul 14 13:02:37 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:38 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-64b157cc-af03-4f3f-b455-64abd64ec56a tempest-VolumesExtendTest-331170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451" returned: 0 in 1.061s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-64b157cc-af03-4f3f-b455-64abd64ec56a tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:38 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 Jul 14 13:02:38 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:38 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-64b157cc-af03-4f3f-b455-64abd64ec56a tempest-VolumesExtendTest-331170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451" returned: 1 in 0.607s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-64b157cc-af03-4f3f-b455-64abd64ec56a tempest-VolumesExtendTest-331170324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:02:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-64b157cc-af03-4f3f-b455-64abd64ec56a tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 2G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-64b157cc-af03-4f3f-b455-64abd64ec56a tempest-VolumesExtendTest-331170324 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 2G" returned: 0 in 0.113s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-64b157cc-af03-4f3f-b455-64abd64ec56a tempest-VolumesExtendTest-331170324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.880s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4faf8e8f-267d-452e-9518-c58754496a4c tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.520s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:39 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-4faf8e8f-267d-452e-9518-c58754496a4c tempest-VolumesDeleteCascade-1393361046 None] Creating offline snapshot fe0a88a4-1b19-4a7d-b5ec-625264358387 of volume 6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:02:39 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[528d7753-6cbd-4a8e-912d-528c1daa28cc]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4faf8e8f-267d-452e-9518-c58754496a4c tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:39 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-64b157cc-af03-4f3f-b455-64abd64ec56a tempest-VolumesExtendTest-331170324 None] Extend volume completed successfully. Jul 14 13:02:39 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471 Jul 14 13:02:39 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] Acquiring lock "cinder-124c4ce4-0b1c-4c40-b461-79d8984fc451-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] Lock "cinder-124c4ce4-0b1c-4c40-b461-79d8984fc451-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:39 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4faf8e8f-267d-452e-9518-c58754496a4c tempest-VolumesDeleteCascade-1393361046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471" returned: 0 in 0.647s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4faf8e8f-267d-452e-9518-c58754496a4c tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:39 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387 1G Jul 14 13:02:39 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] Acquiring lock "cinder-quobyte-124c4ce4-0b1c-4c40-b461-79d8984fc451" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] Lock "cinder-quobyte-124c4ce4-0b1c-4c40-b461-79d8984fc451" acquired by "delete_volume" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:40 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[88124e0c-744a-46b5-811d-fdaa75fc3609]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:40 devstack sudo[95668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 Jul 14 13:02:40 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:40 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451" returned: 0 in 0.582s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:40 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4faf8e8f-267d-452e-9518-c58754496a4c tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387 1G" returned: 0 in 0.811s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4faf8e8f-267d-452e-9518-c58754496a4c tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:40 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387 Jul 14 13:02:40 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:41 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 Jul 14 13:02:41 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:41 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4faf8e8f-267d-452e-9518-c58754496a4c tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387" returned: 0 in 0.798s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:41 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-4faf8e8f-267d-452e-9518-c58754496a4c tempest-VolumesDeleteCascade-1393361046 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387 is being set with open permissions: ugo+rw Jul 14 13:02:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4faf8e8f-267d-452e-9518-c58754496a4c tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:41 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387 Jul 14 13:02:41 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:41 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451" returned: 1 in 0.943s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:02:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:41 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451 Jul 14 13:02:41 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:41 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4faf8e8f-267d-452e-9518-c58754496a4c tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387" returned: 0 in 0.516s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4faf8e8f-267d-452e-9518-c58754496a4c tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:42 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.info Jul 14 13:02:42 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:42 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-124c4ce4-0b1c-4c40-b461-79d8984fc451" returned: 0 in 0.540s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:42 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] Lock "cinder-quobyte-124c4ce4-0b1c-4c40-b461-79d8984fc451" released by "delete_volume" :: held 2.175s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:42 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] Created reservations ['be8512af-cd1f-4070-a8ce-83ad102c6294', 'd5a86c30-265d-4217-acae-aa4bd751deec', '2bdddff1-36c3-462b-bf6e-4723e8b4b854', '1b926d70-4efb-4416-afa0-ab886d8c67f9'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:02:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:42 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:02:42 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:02:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:42 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:02:42 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:42 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4faf8e8f-267d-452e-9518-c58754496a4c tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.info" returned: 0 in 0.473s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:42 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-4faf8e8f-267d-452e-9518-c58754496a4c tempest-VolumesDeleteCascade-1393361046 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.info is being set with open permissions: ugo+rw Jul 14 13:02:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4faf8e8f-267d-452e-9518-c58754496a4c tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:42 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.info Jul 14 13:02:42 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:42 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.310s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:42 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:02:42 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] Deleted volume successfully. Jul 14 13:02:42 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d2c74556-1d9a-424f-9daa-192f8a145e2a tempest-VolumesExtendTest-331170324 None] Lock "cinder-124c4ce4-0b1c-4c40-b461-79d8984fc451-delete_volume" released by "delete_volume" :: held 2.912s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:42 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4faf8e8f-267d-452e-9518-c58754496a4c tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.info" returned: 0 in 0.466s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4faf8e8f-267d-452e-9518-c58754496a4c tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.872s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:43 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-4faf8e8f-267d-452e-9518-c58754496a4c tempest-VolumesDeleteCascade-1393361046 None] Create snapshot completed successfully Jul 14 13:02:43 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-1236ddf1-7c54-409d-bbb3-fca91317ca9d req-16642eae-7ad6-4fec-aa0a-04f89630a709 tempest-AttachVolumeShelveTestJSON-981611705 None] No connector for attachment d8219958-5f74-45a8-a21a-cddec56422d6; skipping storage backend terminate_connection call. {{(pid=86977) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 14 13:02:43 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-1236ddf1-7c54-409d-bbb3-fca91317ca9d req-16642eae-7ad6-4fec-aa0a-04f89630a709 tempest-AttachVolumeShelveTestJSON-981611705 None] Deleting attachment d8219958-5f74-45a8-a21a-cddec56422d6. {{(pid=86977) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 13:02:43 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:02:43 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Flow 'volume_create_manager' (8ecaf50b-2ce7-4594-a547-3e143b4409eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7edb35-b0ce-416e-ac8b-5a4d1844c273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7edb35-b0ce-416e-ac8b-5a4d1844c273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1151487535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4431c820-3842-43f3-abb3-167ab765629c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c64962cf2ede45d586a6702fd9f74a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:02:44Z,use_quota=True,user_id='a7ae3927c245493a92c5bc8b91681c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4f37b3-e786-4dca-8814-27968b7a162f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4f37b3-e786-4dca-8814-27968b7a162f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7bce047-3e32-4af6-8258-7803151c33e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7bce047-3e32-4af6-8258-7803151c33e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4431c820-3842-43f3-abb3-167ab765629c', 'volume_name': 'volume-4431c820-3842-43f3-abb3-167ab765629c', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f90c5aae-0932-4343-9352-ec618a806c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f90c5aae-0932-4343-9352-ec618a806c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f64c59-d651-4e20-8f76-eafad4c186f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:44 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Volume 4431c820-3842-43f3-abb3-167ab765629c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4431c820-3842-43f3-abb3-167ab765629c', 'volume_size': 1} Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1151487535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4431c820-3842-43f3-abb3-167ab765629c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c64962cf2ede45d586a6702fd9f74a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:02:44Z,use_quota=True,user_id='a7ae3927c245493a92c5bc8b91681c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Creating volume 4431c820-3842-43f3-abb3-167ab765629c {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:02:44 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:44 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c 1073741824 Jul 14 13:02:44 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6dabf0f7-eb07-442e-907e-aead21dce102 tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:44 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c 1073741824" returned: 0 in 0.635s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:44 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c Jul 14 13:02:44 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:45 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c" returned: 0 in 0.330s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:45 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:02:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6dabf0f7-eb07-442e-907e-aead21dce102 tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.779s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:45 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-6dabf0f7-eb07-442e-907e-aead21dce102 tempest-VolumesDeleteCascade-1393361046 None] Creating offline snapshot b4984dfa-536e-40a4-82fe-37c2765f6907 of volume 6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:02:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f64c59-d651-4e20-8f76-eafad4c186f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4431c820-3842-43f3-abb3-167ab765629c', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c54439-b9a3-4433-a45e-1b6064aab2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:45 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c1e13a-90a0-4be5-a594-8641c243bff5]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6dabf0f7-eb07-442e-907e-aead21dce102 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:45 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Volume volume-4431c820-3842-43f3-abb3-167ab765629c (4431c820-3842-43f3-abb3-167ab765629c): created successfully Jul 14 13:02:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c54439-b9a3-4433-a45e-1b6064aab2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Flow 'volume_create_manager' (8ecaf50b-2ce7-4594-a547-3e143b4409eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:02:45 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-8ca8dde2-e892-42ca-8f65-e6479bf1e05e tempest-VolumesExtendTest-331170324 None] Created volume successfully. Jul 14 13:02:45 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387 Jul 14 13:02:45 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:45 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6dabf0f7-eb07-442e-907e-aead21dce102 tempest-VolumesDeleteCascade-1393361046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387" returned: 0 in 0.383s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:45 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-6dabf0f7-eb07-442e-907e-aead21dce102 tempest-VolumesDeleteCascade-1393361046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:02:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6dabf0f7-eb07-442e-907e-aead21dce102 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.b4984dfa-536e-40a4-82fe-37c2765f6907 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:45 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.b4984dfa-536e-40a4-82fe-37c2765f6907 1G Jul 14 13:02:45 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:46 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6dabf0f7-eb07-442e-907e-aead21dce102 tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.b4984dfa-536e-40a4-82fe-37c2765f6907 1G" returned: 0 in 0.603s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6dabf0f7-eb07-442e-907e-aead21dce102 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.b4984dfa-536e-40a4-82fe-37c2765f6907 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:46 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.b4984dfa-536e-40a4-82fe-37c2765f6907 Jul 14 13:02:46 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a2602645-8e3c-4f12-9ca3-c82816de6fae tempest-VolumesExtendTest-331170324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:46 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6dabf0f7-eb07-442e-907e-aead21dce102 tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.b4984dfa-536e-40a4-82fe-37c2765f6907" returned: 0 in 0.401s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:46 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-6dabf0f7-eb07-442e-907e-aead21dce102 tempest-VolumesDeleteCascade-1393361046 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.b4984dfa-536e-40a4-82fe-37c2765f6907 is being set with open permissions: ugo+rw Jul 14 13:02:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6dabf0f7-eb07-442e-907e-aead21dce102 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.b4984dfa-536e-40a4-82fe-37c2765f6907 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:46 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.b4984dfa-536e-40a4-82fe-37c2765f6907 Jul 14 13:02:46 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:46 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6dabf0f7-eb07-442e-907e-aead21dce102 tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.b4984dfa-536e-40a4-82fe-37c2765f6907" returned: 0 in 0.285s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6dabf0f7-eb07-442e-907e-aead21dce102 tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.793s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a2602645-8e3c-4f12-9ca3-c82816de6fae tempest-VolumesExtendTest-331170324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.489s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:46 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-a2602645-8e3c-4f12-9ca3-c82816de6fae tempest-VolumesExtendTest-331170324 None] Creating offline snapshot 50306d66-c104-404a-a1ea-87b394fcfc36 of volume 4431c820-3842-43f3-abb3-167ab765629c {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:02:46 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-6dabf0f7-eb07-442e-907e-aead21dce102 tempest-VolumesDeleteCascade-1393361046 None] Create snapshot completed successfully Jul 14 13:02:46 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5f462f-5996-4ea6-9f78-b2f3775ecc33]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a2602645-8e3c-4f12-9ca3-c82816de6fae tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:47 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c Jul 14 13:02:47 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:47 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a2602645-8e3c-4f12-9ca3-c82816de6fae tempest-VolumesExtendTest-331170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c" returned: 0 in 0.642s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a2602645-8e3c-4f12-9ca3-c82816de6fae tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.50306d66-c104-404a-a1ea-87b394fcfc36 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "cinder-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:47 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.50306d66-c104-404a-a1ea-87b394fcfc36 1G Jul 14 13:02:47 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:47 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Performing cascade delete. {{(pid=86977) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 14 13:02:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "cinder-b4984dfa-536e-40a4-82fe-37c2765f6907-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-b4984dfa-536e-40a4-82fe-37c2765f6907-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "cinder-quobyte-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-quobyte-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "cinder-quobyte-b4984dfa-536e-40a4-82fe-37c2765f6907" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-quobyte-b4984dfa-536e-40a4-82fe-37c2765f6907" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:47 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Deleting offline snapshot b4984dfa-536e-40a4-82fe-37c2765f6907 of volume 6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:02:47 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] snapshot_file for this snap is: volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.b4984dfa-536e-40a4-82fe-37c2765f6907 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:02:47 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[e636ac86-663c-418b-b6a7-b9f4c5ff2b12]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.b4984dfa-536e-40a4-82fe-37c2765f6907 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:48 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.b4984dfa-536e-40a4-82fe-37c2765f6907 Jul 14 13:02:48 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:48 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a2602645-8e3c-4f12-9ca3-c82816de6fae tempest-VolumesExtendTest-331170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.50306d66-c104-404a-a1ea-87b394fcfc36 1G" returned: 0 in 0.612s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a2602645-8e3c-4f12-9ca3-c82816de6fae tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4431c820-3842-43f3-abb3-167ab765629c -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.50306d66-c104-404a-a1ea-87b394fcfc36 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:48 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4431c820-3842-43f3-abb3-167ab765629c -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.50306d66-c104-404a-a1ea-87b394fcfc36 Jul 14 13:02:48 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:48 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.b4984dfa-536e-40a4-82fe-37c2765f6907" returned: 0 in 0.508s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:48 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:02:48 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7205d10-50e6-4166-920d-d92571d61bfa]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:48 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387 Jul 14 13:02:48 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:48 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a2602645-8e3c-4f12-9ca3-c82816de6fae tempest-VolumesExtendTest-331170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4431c820-3842-43f3-abb3-167ab765629c -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.50306d66-c104-404a-a1ea-87b394fcfc36" returned: 0 in 0.439s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:48 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-a2602645-8e3c-4f12-9ca3-c82816de6fae tempest-VolumesExtendTest-331170324 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.50306d66-c104-404a-a1ea-87b394fcfc36 is being set with open permissions: ugo+rw Jul 14 13:02:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a2602645-8e3c-4f12-9ca3-c82816de6fae tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.50306d66-c104-404a-a1ea-87b394fcfc36 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:48 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.50306d66-c104-404a-a1ea-87b394fcfc36 Jul 14 13:02:48 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:49 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a2602645-8e3c-4f12-9ca3-c82816de6fae tempest-VolumesExtendTest-331170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.50306d66-c104-404a-a1ea-87b394fcfc36" returned: 0 in 0.475s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a2602645-8e3c-4f12-9ca3-c82816de6fae tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:49 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.info Jul 14 13:02:49 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:49 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387" returned: 0 in 0.778s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:49 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:02:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.b4984dfa-536e-40a4-82fe-37c2765f6907 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:49 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.b4984dfa-536e-40a4-82fe-37c2765f6907 Jul 14 13:02:49 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:49 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a2602645-8e3c-4f12-9ca3-c82816de6fae tempest-VolumesExtendTest-331170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.info" returned: 0 in 0.441s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:49 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-a2602645-8e3c-4f12-9ca3-c82816de6fae tempest-VolumesExtendTest-331170324 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.info is being set with open permissions: ugo+rw Jul 14 13:02:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a2602645-8e3c-4f12-9ca3-c82816de6fae tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:49 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.info Jul 14 13:02:49 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:49 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.b4984dfa-536e-40a4-82fe-37c2765f6907" returned: 0 in 0.594s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.b4984dfa-536e-40a4-82fe-37c2765f6907 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:49 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.b4984dfa-536e-40a4-82fe-37c2765f6907 Jul 14 13:02:49 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:50 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a2602645-8e3c-4f12-9ca3-c82816de6fae tempest-VolumesExtendTest-331170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.info" returned: 0 in 0.419s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a2602645-8e3c-4f12-9ca3-c82816de6fae tempest-VolumesExtendTest-331170324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.176s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:50 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-a2602645-8e3c-4f12-9ca3-c82816de6fae tempest-VolumesExtendTest-331170324 None] Create snapshot completed successfully Jul 14 13:02:50 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.b4984dfa-536e-40a4-82fe-37c2765f6907" returned: 0 in 0.472s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:50 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-quobyte-b4984dfa-536e-40a4-82fe-37c2765f6907" released by "_delete_snapshot" :: held 2.486s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:50 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-quobyte-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471" released by "delete_snapshot" :: held 2.525s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:50 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Created reservations ['3c8d92bc-2cfd-44f6-9d61-299383d95491', '05b00933-6c9f-4655-9d41-6bc8dd88c001', 'c3e9dff8-1306-4347-8ee7-8d50fecb92d8', '6b72fd57-2b6c-4573-9519-4c0b0095650e'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:02:50 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Delete snapshot completed successfully. Jul 14 13:02:50 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-b4984dfa-536e-40a4-82fe-37c2765f6907-delete_snapshot" released by "delete_snapshot" :: held 2.760s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:50 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "cinder-fe0a88a4-1b19-4a7d-b5ec-625264358387-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:50 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-fe0a88a4-1b19-4a7d-b5ec-625264358387-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:50 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "cinder-quobyte-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:50 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-quobyte-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:50 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "cinder-quobyte-fe0a88a4-1b19-4a7d-b5ec-625264358387" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:50 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-quobyte-fe0a88a4-1b19-4a7d-b5ec-625264358387" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Deleting offline snapshot fe0a88a4-1b19-4a7d-b5ec-625264358387 of volume 6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:02:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] snapshot_file for this snap is: volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:02:50 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[851f57f0-40a6-429c-9a78-5d478c44f299]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:50 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387 Jul 14 13:02:50 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c49bad0a-ab24-4509-97e4-33c6394597ca tempest-VolumesExtendTest-331170324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c49bad0a-ab24-4509-97e4-33c6394597ca tempest-VolumesExtendTest-331170324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:50 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[804a28cd-969e-48b0-aff4-892c3292e130]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c49bad0a-ab24-4509-97e4-33c6394597ca tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:51 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c Jul 14 13:02:51 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:51 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387" returned: 0 in 0.472s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:02:51 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e198936-13b4-46c1-b814-d9260769f45d]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:51 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471 Jul 14 13:02:51 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:51 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c49bad0a-ab24-4509-97e4-33c6394597ca tempest-VolumesExtendTest-331170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c" returned: 0 in 0.548s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c49bad0a-ab24-4509-97e4-33c6394597ca tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.50306d66-c104-404a-a1ea-87b394fcfc36 2G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c49bad0a-ab24-4509-97e4-33c6394597ca tempest-VolumesExtendTest-331170324 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.50306d66-c104-404a-a1ea-87b394fcfc36 2G" returned: 0 in 0.142s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c49bad0a-ab24-4509-97e4-33c6394597ca tempest-VolumesExtendTest-331170324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.742s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:51 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c49bad0a-ab24-4509-97e4-33c6394597ca tempest-VolumesExtendTest-331170324 None] Extend volume completed successfully. Jul 14 13:02:51 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471" returned: 0 in 0.507s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:51 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387 Jul 14 13:02:51 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:52 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387" returned: 0 in 0.398s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-edf13d12-d5b0-4173-8436-9c815d46fda0 tempest-VolumesExtendTest-331170324 None] Acquiring lock "cinder-50306d66-c104-404a-a1ea-87b394fcfc36-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:52 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387 Jul 14 13:02:52 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-edf13d12-d5b0-4173-8436-9c815d46fda0 tempest-VolumesExtendTest-331170324 None] Lock "cinder-50306d66-c104-404a-a1ea-87b394fcfc36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-edf13d12-d5b0-4173-8436-9c815d46fda0 tempest-VolumesExtendTest-331170324 None] Acquiring lock "cinder-quobyte-4431c820-3842-43f3-abb3-167ab765629c" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-edf13d12-d5b0-4173-8436-9c815d46fda0 tempest-VolumesExtendTest-331170324 None] Lock "cinder-quobyte-4431c820-3842-43f3-abb3-167ab765629c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-edf13d12-d5b0-4173-8436-9c815d46fda0 tempest-VolumesExtendTest-331170324 None] Acquiring lock "cinder-quobyte-50306d66-c104-404a-a1ea-87b394fcfc36" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-edf13d12-d5b0-4173-8436-9c815d46fda0 tempest-VolumesExtendTest-331170324 None] Lock "cinder-quobyte-50306d66-c104-404a-a1ea-87b394fcfc36" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-edf13d12-d5b0-4173-8436-9c815d46fda0 tempest-VolumesExtendTest-331170324 None] Deleting offline snapshot 50306d66-c104-404a-a1ea-87b394fcfc36 of volume 4431c820-3842-43f3-abb3-167ab765629c {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-edf13d12-d5b0-4173-8436-9c815d46fda0 tempest-VolumesExtendTest-331170324 None] snapshot_file for this snap is: volume-4431c820-3842-43f3-abb3-167ab765629c.50306d66-c104-404a-a1ea-87b394fcfc36 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9c4b76-6b99-461a-a8bd-67d03e4a1c9c]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-edf13d12-d5b0-4173-8436-9c815d46fda0 tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.50306d66-c104-404a-a1ea-87b394fcfc36 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:52 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.50306d66-c104-404a-a1ea-87b394fcfc36 Jul 14 13:02:52 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:52 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471.fe0a88a4-1b19-4a7d-b5ec-625264358387" returned: 0 in 0.295s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-quobyte-fe0a88a4-1b19-4a7d-b5ec-625264358387" released by "_delete_snapshot" :: held 1.805s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-quobyte-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471" released by "delete_snapshot" :: held 1.833s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Created reservations ['b933ad80-7592-4bbe-a8a5-c135e986811c', 'e4fa1e2a-759f-46a7-94bb-e08fa43ef85a', '075561cb-ab7f-42aa-b4c3-426525468d5e', '174ad97c-88ab-43af-ad5d-76863c8bc1f2'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:02:52 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Delete snapshot completed successfully. Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-fe0a88a4-1b19-4a7d-b5ec-625264358387-delete_snapshot" released by "delete_snapshot" :: held 2.007s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Snapshots deleted, issuing volume delete {{(pid=86977) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "cinder-quobyte-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-quobyte-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471" acquired by "delete_volume" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79b96a3-ce35-45ed-aab3-b0d532637458]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:52 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-edf13d12-d5b0-4173-8436-9c815d46fda0 tempest-VolumesExtendTest-331170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.50306d66-c104-404a-a1ea-87b394fcfc36" returned: 0 in 0.412s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-edf13d12-d5b0-4173-8436-9c815d46fda0 tempest-VolumesExtendTest-331170324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4431c820-3842-43f3-abb3-167ab765629c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecb5d3b-6019-4e18-ac94-c8a5bf6146c4]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-edf13d12-d5b0-4173-8436-9c815d46fda0 tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:52 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471 Jul 14 13:02:52 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:52 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c Jul 14 13:02:52 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:53 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471" returned: 0 in 0.414s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:53 devstack sudo[95896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471 Jul 14 13:02:53 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:53 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-edf13d12-d5b0-4173-8436-9c815d46fda0 tempest-VolumesExtendTest-331170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c" returned: 0 in 0.411s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-edf13d12-d5b0-4173-8436-9c815d46fda0 tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.50306d66-c104-404a-a1ea-87b394fcfc36 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:53 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.50306d66-c104-404a-a1ea-87b394fcfc36 Jul 14 13:02:53 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:53 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471" returned: 0 in 0.287s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:53 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-quobyte-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471" released by "delete_volume" :: held 0.779s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:53 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Created reservations ['c9cc7ac3-d4bc-4aef-b700-ac8c520d9725', '89ba605f-e249-47ee-b363-d87db26a2feb', '19d12335-ecd8-4218-874b-5e3fd20f59c1', '4cd725d5-5543-45d8-afb8-03d66b2f3be3'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:02:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:53 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:02:53 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:02:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:53 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:02:53 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:53 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-edf13d12-d5b0-4173-8436-9c815d46fda0 tempest-VolumesExtendTest-331170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.50306d66-c104-404a-a1ea-87b394fcfc36" returned: 0 in 0.499s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-edf13d12-d5b0-4173-8436-9c815d46fda0 tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.50306d66-c104-404a-a1ea-87b394fcfc36 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:53 devstack sudo[95907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.50306d66-c104-404a-a1ea-87b394fcfc36 Jul 14 13:02:53 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:53 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.282s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:53 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:02:53 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Deleted volume successfully. Jul 14 13:02:53 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5a57793-050f-4338-ad3d-7e9f17d733f0 tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-6c8bd0ee-d7ec-40c2-a065-8aa8b10ba471-delete_volume" released by "delete_volume" :: held 6.164s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:53 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-edf13d12-d5b0-4173-8436-9c815d46fda0 tempest-VolumesExtendTest-331170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c.50306d66-c104-404a-a1ea-87b394fcfc36" returned: 0 in 0.277s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:53 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-edf13d12-d5b0-4173-8436-9c815d46fda0 tempest-VolumesExtendTest-331170324 None] Lock "cinder-quobyte-50306d66-c104-404a-a1ea-87b394fcfc36" released by "_delete_snapshot" :: held 1.721s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:53 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-edf13d12-d5b0-4173-8436-9c815d46fda0 tempest-VolumesExtendTest-331170324 None] Lock "cinder-quobyte-4431c820-3842-43f3-abb3-167ab765629c" released by "delete_snapshot" :: held 1.753s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:54 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-edf13d12-d5b0-4173-8436-9c815d46fda0 tempest-VolumesExtendTest-331170324 None] Created reservations ['3f460976-f81b-43f3-99c6-4f09b11a463f', '167a1180-bad2-4dd4-87c5-520a178ac678', '2eb30557-9125-45cd-939d-4fb7e15be4f1', '6c90197c-5a34-4b10-a5ca-45e8b96e64a8'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:02:54 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-edf13d12-d5b0-4173-8436-9c815d46fda0 tempest-VolumesExtendTest-331170324 None] Delete snapshot completed successfully. Jul 14 13:02:54 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-edf13d12-d5b0-4173-8436-9c815d46fda0 tempest-VolumesExtendTest-331170324 None] Lock "cinder-50306d66-c104-404a-a1ea-87b394fcfc36-delete_snapshot" released by "delete_snapshot" :: held 2.024s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:54 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d8090b4d-8067-46f8-9cd9-646a168ff17d tempest-VolumesExtendTest-331170324 None] Acquiring lock "cinder-4431c820-3842-43f3-abb3-167ab765629c-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:54 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d8090b4d-8067-46f8-9cd9-646a168ff17d tempest-VolumesExtendTest-331170324 None] Lock "cinder-4431c820-3842-43f3-abb3-167ab765629c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:54 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d8090b4d-8067-46f8-9cd9-646a168ff17d tempest-VolumesExtendTest-331170324 None] Acquiring lock "cinder-quobyte-4431c820-3842-43f3-abb3-167ab765629c" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:02:54 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d8090b4d-8067-46f8-9cd9-646a168ff17d tempest-VolumesExtendTest-331170324 None] Lock "cinder-quobyte-4431c820-3842-43f3-abb3-167ab765629c" acquired by "delete_volume" :: waited 0.043s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:02:54 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[a476fb0f-eb8f-4854-9cc4-1f77fb09b282]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d8090b4d-8067-46f8-9cd9-646a168ff17d tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:54 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c Jul 14 13:02:54 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:55 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d8090b4d-8067-46f8-9cd9-646a168ff17d tempest-VolumesExtendTest-331170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c" returned: 0 in 0.597s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d8090b4d-8067-46f8-9cd9-646a168ff17d tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:55 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c Jul 14 13:02:55 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Flow 'volume_create_manager' (9fd8f571-fe3c-4363-ae7a-aec263004d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0430bad2-c8ea-430c-aabb-419ccf9d48a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0430bad2-c8ea-430c-aabb-419ccf9d48a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1119594800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e8bd8b-ecfc-4882-b245-a8f20c7d58af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9870b5282804c3786acad3cf6f9689c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:02:55Z,use_quota=True,user_id='7c4d9308f0904b15ab0e85f3385d7e37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6aa7219-b856-44a3-b6b7-4ba29a21acbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6aa7219-b856-44a3-b6b7-4ba29a21acbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe76949-a631-415d-8be8-3fe53eb5552e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe76949-a631-415d-8be8-3fe53eb5552e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19e8bd8b-ecfc-4882-b245-a8f20c7d58af', 'volume_name': 'volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff488561-b583-4f6b-953b-805a7f4de106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff488561-b583-4f6b-953b-805a7f4de106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92620898-366a-4462-b6d0-e3062e953cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:55 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Volume 19e8bd8b-ecfc-4882-b245-a8f20c7d58af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af', 'volume_size': 1} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1119594800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e8bd8b-ecfc-4882-b245-a8f20c7d58af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9870b5282804c3786acad3cf6f9689c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:02:55Z,use_quota=True,user_id='7c4d9308f0904b15ab0e85f3385d7e37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Creating volume 19e8bd8b-ecfc-4882-b245-a8f20c7d58af {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:02:55 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:02:55 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d8090b4d-8067-46f8-9cd9-646a168ff17d tempest-VolumesExtendTest-331170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4431c820-3842-43f3-abb3-167ab765629c" returned: 0 in 0.284s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:55 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af 1073741824 Jul 14 13:02:55 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d8090b4d-8067-46f8-9cd9-646a168ff17d tempest-VolumesExtendTest-331170324 None] Lock "cinder-quobyte-4431c820-3842-43f3-abb3-167ab765629c" released by "delete_volume" :: held 1.035s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-d8090b4d-8067-46f8-9cd9-646a168ff17d tempest-VolumesExtendTest-331170324 None] Created reservations ['dd209cda-261a-4490-a616-bd91b8f72851', '0d05f071-de21-4a61-8cf1-8d3f3b60965c', 'f086f542-98a3-4309-ac87-7a9c90ab5328', '2ece907e-40b2-40cf-8d0b-a0017d8e3701'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d8090b4d-8067-46f8-9cd9-646a168ff17d tempest-VolumesExtendTest-331170324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d8090b4d-8067-46f8-9cd9-646a168ff17d tempest-VolumesExtendTest-331170324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d8090b4d-8067-46f8-9cd9-646a168ff17d tempest-VolumesExtendTest-331170324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d8090b4d-8067-46f8-9cd9-646a168ff17d tempest-VolumesExtendTest-331170324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d8090b4d-8067-46f8-9cd9-646a168ff17d tempest-VolumesExtendTest-331170324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d8090b4d-8067-46f8-9cd9-646a168ff17d tempest-VolumesExtendTest-331170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:55 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:02:55 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:56 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d8090b4d-8067-46f8-9cd9-646a168ff17d tempest-VolumesExtendTest-331170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.422s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:56 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-d8090b4d-8067-46f8-9cd9-646a168ff17d tempest-VolumesExtendTest-331170324 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:02:56 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-d8090b4d-8067-46f8-9cd9-646a168ff17d tempest-VolumesExtendTest-331170324 None] Deleted volume successfully. Jul 14 13:02:56 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d8090b4d-8067-46f8-9cd9-646a168ff17d tempest-VolumesExtendTest-331170324 None] Lock "cinder-4431c820-3842-43f3-abb3-167ab765629c-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:02:56 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af 1073741824" returned: 0 in 0.737s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:56 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af Jul 14 13:02:56 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:56 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af" returned: 0 in 0.325s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:02:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:02:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92620898-366a-4462-b6d0-e3062e953cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fbac3a6-b5e0-4552-99e8-3f7d243608f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:02:56 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Volume volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af (19e8bd8b-ecfc-4882-b245-a8f20c7d58af): created successfully Jul 14 13:02:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fbac3a6-b5e0-4552-99e8-3f7d243608f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:02:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Flow 'volume_create_manager' (9fd8f571-fe3c-4363-ae7a-aec263004d68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:02:56 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-1db91180-1231-4460-808c-f2ae6020d6fb tempest-VolumesDeleteCascade-1393361046 None] Created volume successfully. Jul 14 13:02:57 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=105,cinder:UPDATE=123,cinder:DELETE=13,cinder:INSERT=42 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:02:57 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=126,cinder:INSERT=41,cinder:UPDATE=124,cinder:DELETE=8 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:02:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-31940e79-aefa-438d-904d-49f4e5588e32 tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:02:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-31940e79-aefa-438d-904d-49f4e5588e32 tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:02:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-31940e79-aefa-438d-904d-49f4e5588e32 tempest-VolumesDeleteCascade-1393361046 None] Creating offline snapshot aa3d8f58-0ecd-46f4-9277-04dc5d157f32 of volume 19e8bd8b-ecfc-4882-b245-a8f20c7d58af {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:02:58 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a8c63a-3de5-457b-9a88-f816d6bfefe7]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:02:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31940e79-aefa-438d-904d-49f4e5588e32 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:58 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af Jul 14 13:02:58 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:58 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31940e79-aefa-438d-904d-49f4e5588e32 tempest-VolumesDeleteCascade-1393361046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af" returned: 0 in 0.513s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31940e79-aefa-438d-904d-49f4e5588e32 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:58 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32 1G Jul 14 13:02:58 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:59 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31940e79-aefa-438d-904d-49f4e5588e32 tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32 1G" returned: 0 in 0.532s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31940e79-aefa-438d-904d-49f4e5588e32 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:59 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32 Jul 14 13:02:59 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:59 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31940e79-aefa-438d-904d-49f4e5588e32 tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32" returned: 0 in 0.334s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:59 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-31940e79-aefa-438d-904d-49f4e5588e32 tempest-VolumesDeleteCascade-1393361046 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32 is being set with open permissions: ugo+rw Jul 14 13:02:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31940e79-aefa-438d-904d-49f4e5588e32 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:59 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32 Jul 14 13:02:59 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:02:59 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Jul 14 13:02:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31940e79-aefa-438d-904d-49f4e5588e32 tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32" returned: 0 in 0.246s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:02:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31940e79-aefa-438d-904d-49f4e5588e32 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:02:59 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.info Jul 14 13:02:59 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:00 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31940e79-aefa-438d-904d-49f4e5588e32 tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.info" returned: 0 in 0.303s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:00 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-31940e79-aefa-438d-904d-49f4e5588e32 tempest-VolumesDeleteCascade-1393361046 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.info is being set with open permissions: ugo+rw Jul 14 13:03:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31940e79-aefa-438d-904d-49f4e5588e32 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:00 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.info Jul 14 13:03:00 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:00 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31940e79-aefa-438d-904d-49f4e5588e32 tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.info" returned: 0 in 0.333s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-31940e79-aefa-438d-904d-49f4e5588e32 tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.422s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:00 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-31940e79-aefa-438d-904d-49f4e5588e32 tempest-VolumesDeleteCascade-1393361046 None] Create snapshot completed successfully Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Flow 'volume_create_manager' (5effe20f-c293-4bdc-a7ba-3dbea075588c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41bd49ab-49f3-4562-943b-0b79e43899a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41bd49ab-49f3-4562-943b-0b79e43899a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-146650036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da223c1d-cca3-47a4-8d12-b3d02383288c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9870b5282804c3786acad3cf6f9689c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aa3d8f58-0ecd-46f4-9277-04dc5d157f32,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:02Z,use_quota=True,user_id='7c4d9308f0904b15ab0e85f3385d7e37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfddb31-fb1a-4673-aab7-619fc586a674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfddb31-fb1a-4673-aab7-619fc586a674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b644c40c-8912-49eb-b608-c468d71d97e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b644c40c-8912-49eb-b608-c468d71d97e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'da223c1d-cca3-47a4-8d12-b3d02383288c', 'volume_name': 'volume-da223c1d-cca3-47a4-8d12-b3d02383288c', 'volume_size': 1, 'snapshot_id': 'aa3d8f58-0ecd-46f4-9277-04dc5d157f32'}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45776189-a376-4cd4-b0b9-cc95e7ebf7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45776189-a376-4cd4-b0b9-cc95e7ebf7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79316c1f-f85a-4577-8fc2-9a4944f008d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:01 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Volume da223c1d-cca3-47a4-8d12-b3d02383288c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-da223c1d-cca3-47a4-8d12-b3d02383288c', 'volume_size': 1, 'snapshot_id': 'aa3d8f58-0ecd-46f4-9277-04dc5d157f32'} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "cinder-quobyte-aa3d8f58-0ecd-46f4-9277-04dc5d157f32-da223c1d-cca3-47a4-8d12-b3d02383288c" by "_create_volume_from_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-quobyte-aa3d8f58-0ecd-46f4-9277-04dc5d157f32-da223c1d-cca3-47a4-8d12-b3d02383288c" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Creating volume da223c1d-cca3-47a4-8d12-b3d02383288c from snapshot aa3d8f58-0ecd-46f4-9277-04dc5d157f32 {{(pid=86977) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "cinder-quobyte-da223c1d-cca3-47a4-8d12-b3d02383288c" by "_copy_volume_from_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-quobyte-da223c1d-cca3-47a4-8d12-b3d02383288c" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] snapshot: aa3d8f58-0ecd-46f4-9277-04dc5d157f32, volume: da223c1d-cca3-47a4-8d12-b3d02383288c, {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f0b479-4beb-4366-b7de-8a10986f41a1]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:02 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32 Jul 14 13:03:02 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:02 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32" returned: 0 in 0.443s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:03:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 13:03:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Creating direct copy from snapshot {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 13:03:02 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[952b82bc-04ea-4e01-9fab-b6546e4d79d0]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:02 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af Jul 14 13:03:02 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:02 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af" returned: 0 in 0.522s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:02 devstack cinder-volume[86977]: DEBUG cinder.utils [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Path /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da223c1d-cca3-47a4-8d12-b3d02383288c not found in is_blk_device check {{(pid=86977) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 13:03:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da223c1d-cca3-47a4-8d12-b3d02383288c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:03 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da223c1d-cca3-47a4-8d12-b3d02383288c Jul 14 13:03:03 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:03 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:03:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Flow 'volume_create_manager' (d8023175-5ae8-428e-9c1d-b51552c690ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cdf320b-a12d-457e-bc70-c82920f5d739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cdf320b-a12d-457e-bc70-c82920f5d739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1499007419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a776181d6140d6883ac80cb97795ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:03Z,use_quota=True,user_id='be67f5f61375488fa2a986d7c99e25bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d90787d-4200-453c-b1e1-4dd225eb0994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d90787d-4200-453c-b1e1-4dd225eb0994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901fb999-e870-4668-a07a-816bac54d1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901fb999-e870-4668-a07a-816bac54d1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4', 'volume_name': 'volume-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2883d56-d445-43c5-a2ba-cba4e1230290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2883d56-d445-43c5-a2ba-cba4e1230290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4d56a3-4820-4b78-b4c0-614548c65e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:03 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Volume fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4', 'volume_size': 1} Jul 14 13:03:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:03 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:03:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Flow 'volume_create_manager' (ec31f22c-8dbe-40f8-b4c4-a41c325c3961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9418486f-73e9-43fe-903f-9e38f47eb044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9418486f-73e9-43fe-903f-9e38f47eb044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1521964758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c9bda3-aaf3-4223-b74a-e5d34fb4c347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c282fc9de11f4224b113ee81b37c41c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:04Z,use_quota=True,user_id='7ccfd8e260394c1ea60a1bb9b6e55cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a555d848-0a2d-4311-af75-04a33fd559d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a555d848-0a2d-4311-af75-04a33fd559d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f2ccb5-9741-4aa1-88da-ad2be73e9d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f2ccb5-9741-4aa1-88da-ad2be73e9d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66c9bda3-aaf3-4223-b74a-e5d34fb4c347', 'volume_name': 'volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347', 'volume_size': 2}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5112fb9a-948d-4c15-ab81-2e652894bed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5112fb9a-948d-4c15-ab81-2e652894bed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4737b77-6aed-4f33-8601-7e3719380fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:04 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Volume 66c9bda3-aaf3-4223-b74a-e5d34fb4c347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347', 'volume_size': 2} Jul 14 13:03:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:08 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da223c1d-cca3-47a4-8d12-b3d02383288c" returned: 0 in 5.933s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:08 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74024a2-aefb-4317-be5c-cc3844d3118f]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:09 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af Jul 14 13:03:09 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:09 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af" returned: 0 in 0.533s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:09 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Image conversion details: src /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af, size 1024.00 MB, duration 5.93 sec, destination /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da223c1d-cca3-47a4-8d12-b3d02383288c {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:03:09 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Converted 1024.00 MB image at 172.57 MB/s Jul 14 13:03:09 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da223c1d-cca3-47a4-8d12-b3d02383288c is being set with open permissions: ugo+rw Jul 14 13:03:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da223c1d-cca3-47a4-8d12-b3d02383288c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:09 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da223c1d-cca3-47a4-8d12-b3d02383288c Jul 14 13:03:09 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:09 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da223c1d-cca3-47a4-8d12-b3d02383288c" returned: 0 in 0.242s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-quobyte-da223c1d-cca3-47a4-8d12-b3d02383288c" released by "_copy_volume_from_snapshot" :: held 7.775s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-quobyte-aa3d8f58-0ecd-46f4-9277-04dc5d157f32-da223c1d-cca3-47a4-8d12-b3d02383288c" released by "_create_volume_from_snapshot" :: held 7.804s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.821s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.450s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1499007419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a776181d6140d6883ac80cb97795ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:03Z,use_quota=True,user_id='be67f5f61375488fa2a986d7c99e25bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:03:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Creating volume fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:03:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:03:09 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:03:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:09 devstack sudo[96104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4 1073741824 Jul 14 13:03:09 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79316c1f-f85a-4577-8fc2-9a4944f008d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da223c1d-cca3-47a4-8d12-b3d02383288c', 'volume_size': 1, 'snapshot_id': 'aa3d8f58-0ecd-46f4-9277-04dc5d157f32'}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81d1db81-a97e-41bd-81cf-22a604f3d9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:09 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Volume volume-da223c1d-cca3-47a4-8d12-b3d02383288c (da223c1d-cca3-47a4-8d12-b3d02383288c): created successfully Jul 14 13:03:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81d1db81-a97e-41bd-81cf-22a604f3d9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Flow 'volume_create_manager' (5effe20f-c293-4bdc-a7ba-3dbea075588c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:09 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-482fc4d6-f80a-40d8-a784-c9f8af2e7279 tempest-VolumesDeleteCascade-1393361046 None] Created volume successfully. Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "cinder-19e8bd8b-ecfc-4882-b245-a8f20c7d58af-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-19e8bd8b-ecfc-4882-b245-a8f20c7d58af-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Performing cascade delete. {{(pid=86977) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "cinder-aa3d8f58-0ecd-46f4-9277-04dc5d157f32-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-aa3d8f58-0ecd-46f4-9277-04dc5d157f32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "cinder-quobyte-19e8bd8b-ecfc-4882-b245-a8f20c7d58af" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:10 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-quobyte-19e8bd8b-ecfc-4882-b245-a8f20c7d58af" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "cinder-quobyte-aa3d8f58-0ecd-46f4-9277-04dc5d157f32" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4 1073741824" returned: 0 in 0.455s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-quobyte-aa3d8f58-0ecd-46f4-9277-04dc5d157f32" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Deleting offline snapshot aa3d8f58-0ecd-46f4-9277-04dc5d157f32 of volume 19e8bd8b-ecfc-4882-b245-a8f20c7d58af {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] snapshot_file for this snap is: volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[74721e8c-4985-41ca-b416-1b2568c096cc]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:10 devstack sudo[96113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4 Jul 14 13:03:10 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:10 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32 Jul 14 13:03:10 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:10 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4" returned: 0 in 0.266s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.357s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1521964758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c9bda3-aaf3-4223-b74a-e5d34fb4c347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c282fc9de11f4224b113ee81b37c41c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:04Z,use_quota=True,user_id='7ccfd8e260394c1ea60a1bb9b6e55cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Creating volume 66c9bda3-aaf3-4223-b74a-e5d34fb4c347 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:03:10 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347 2147483648 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:10 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347 2147483648 Jul 14 13:03:10 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4d56a3-4820-4b78-b4c0-614548c65e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b312b8-52b0-4042-811d-9cccb1cda8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:10 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Volume volume-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4 (fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4): created successfully Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b312b8-52b0-4042-811d-9cccb1cda8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Flow 'volume_create_manager' (d8023175-5ae8-428e-9c1d-b51552c690ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:10 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32" returned: 0 in 0.379s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:03:10 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-a1564460-d0ed-49db-b379-d55fd9daee81 tempest-AttachVolumeNegativeTest-115818279 None] Created volume successfully. Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ea40fe-460a-40b1-92ff-2795a475473f]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:10 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af Jul 14 13:03:10 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:11 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347 2147483648" returned: 0 in 0.478s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:11 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af" returned: 0 in 0.409s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:11 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32 Jul 14 13:03:11 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:11 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347 Jul 14 13:03:11 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:11 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347" returned: 0 in 0.298s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4737b77-6aed-4f33-8601-7e3719380fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347', 'volume_size': 2}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bcf49a6-702d-42b6-bd93-2c4aaf691392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:11 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Volume volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347 (66c9bda3-aaf3-4223-b74a-e5d34fb4c347): created successfully Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bcf49a6-702d-42b6-bd93-2c4aaf691392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Flow 'volume_create_manager' (ec31f22c-8dbe-40f8-b4c4-a41c325c3961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:11 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-2af437aa-4a78-42c5-9006-c779a1aa82af tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Created volume successfully. Jul 14 13:03:11 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32" returned: 0 in 0.438s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:11 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32 Jul 14 13:03:11 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:11 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af.aa3d8f58-0ecd-46f4-9277-04dc5d157f32" returned: 0 in 0.258s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-quobyte-aa3d8f58-0ecd-46f4-9277-04dc5d157f32" released by "_delete_snapshot" :: held 1.573s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-quobyte-19e8bd8b-ecfc-4882-b245-a8f20c7d58af" released by "delete_snapshot" :: held 1.602s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Created reservations ['07ba6f15-767e-42ad-bdc3-34e511a7c185', '05669407-6670-4d40-beef-923bbb0a5d8b', '9845fcae-1f46-4a82-9900-65947752d7f8', 'b2cb2509-8ffc-47d1-90b5-3a30b98fc300'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:11 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Delete snapshot completed successfully. Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-aa3d8f58-0ecd-46f4-9277-04dc5d157f32-delete_snapshot" released by "delete_snapshot" :: held 1.762s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Snapshots deleted, issuing volume delete {{(pid=86977) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "cinder-quobyte-19e8bd8b-ecfc-4882-b245-a8f20c7d58af" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-quobyte-19e8bd8b-ecfc-4882-b245-a8f20c7d58af" acquired by "delete_volume" :: waited 0.025s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-3efe7780-f684-4b6f-9cde-0419b11c6c6e req-20a88ea6-4829-4a87-a8ce-1a1ba88b7342 tempest-AttachVolumeNegativeTest-115818279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-3efe7780-f684-4b6f-9cde-0419b11c6c6e req-20a88ea6-4829-4a87-a8ce-1a1ba88b7342 tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4b7967-062a-4fb0-a280-3258c2001d93]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a68cd1a-dcb1-4600-9607-d65a4367577a]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-3efe7780-f684-4b6f-9cde-0419b11c6c6e req-20a88ea6-4829-4a87-a8ce-1a1ba88b7342 tempest-AttachVolumeNegativeTest-115818279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:12 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af Jul 14 13:03:12 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:12 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4 Jul 14 13:03:12 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:12 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af" returned: 0 in 0.389s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:12 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-3efe7780-f684-4b6f-9cde-0419b11c6c6e req-20a88ea6-4829-4a87-a8ce-1a1ba88b7342 tempest-AttachVolumeNegativeTest-115818279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4" returned: 0 in 0.388s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-3efe7780-f684-4b6f-9cde-0419b11c6c6e req-20a88ea6-4829-4a87-a8ce-1a1ba88b7342 tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.412s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:12 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af Jul 14 13:03:12 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-3efe7780-f684-4b6f-9cde-0419b11c6c6e req-20a88ea6-4829-4a87-a8ce-1a1ba88b7342 tempest-AttachVolumeNegativeTest-115818279 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1', 'name': 'volume-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc638a61-bb2c-4452-ab85-90af5a1b04b1', 'enforce_multipath': True} {{(pid=86977) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 13:03:12 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-3efe7780-f684-4b6f-9cde-0419b11c6c6e req-20a88ea6-4829-4a87-a8ce-1a1ba88b7342 tempest-AttachVolumeNegativeTest-115818279 None] attachment_update completed successfully. Jul 14 13:03:12 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-19e8bd8b-ecfc-4882-b245-a8f20c7d58af" returned: 0 in 0.290s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:12 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-quobyte-19e8bd8b-ecfc-4882-b245-a8f20c7d58af" released by "delete_volume" :: held 0.746s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:12 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Created reservations ['8490d1ff-ef7f-4379-b49b-fecc2ff5bb27', '74639d8e-87c9-49ee-a8c0-51dee35b9be4', 'b03cee4f-3f71-491a-a6a5-13856b04f8f9', '090dd0bb-945b-45b7-be02-3834734614bb'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c337eaed-ff9c-4258-b90f-a40d202b5050 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c337eaed-ff9c-4258-b90f-a40d202b5050 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-c337eaed-ff9c-4258-b90f-a40d202b5050 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Creating offline snapshot 1af6bbe6-0ed0-4e27-95b5-eb623da9b113 of volume 66c9bda3-aaf3-4223-b74a-e5d34fb4c347 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:03:12 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43aa8cc-e5d2-46fe-96cd-c7add09f585c]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c337eaed-ff9c-4258-b90f-a40d202b5050 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:12 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:03:12 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:13 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347 Jul 14 13:03:13 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:13 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.289s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:13 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:03:13 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Deleted volume successfully. Jul 14 13:03:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-025c5256-b241-46e3-a58e-bbdfc4c5344a tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-19e8bd8b-ecfc-4882-b245-a8f20c7d58af-delete_volume" released by "delete_volume" :: held 3.122s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:13 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c337eaed-ff9c-4258-b90f-a40d202b5050 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347" returned: 0 in 0.402s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c337eaed-ff9c-4258-b90f-a40d202b5050 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.1af6bbe6-0ed0-4e27-95b5-eb623da9b113 2G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:13 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.1af6bbe6-0ed0-4e27-95b5-eb623da9b113 2G Jul 14 13:03:13 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4c839549-1550-4b1d-a0c8-7bc983ea214a tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "cinder-da223c1d-cca3-47a4-8d12-b3d02383288c-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4c839549-1550-4b1d-a0c8-7bc983ea214a tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-da223c1d-cca3-47a4-8d12-b3d02383288c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4c839549-1550-4b1d-a0c8-7bc983ea214a tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "cinder-quobyte-da223c1d-cca3-47a4-8d12-b3d02383288c" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4c839549-1550-4b1d-a0c8-7bc983ea214a tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-quobyte-da223c1d-cca3-47a4-8d12-b3d02383288c" acquired by "delete_volume" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:13 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[12acad66-cb2f-4f0c-986d-89dc140f1c99]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4c839549-1550-4b1d-a0c8-7bc983ea214a tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da223c1d-cca3-47a4-8d12-b3d02383288c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:13 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da223c1d-cca3-47a4-8d12-b3d02383288c Jul 14 13:03:13 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:13 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c337eaed-ff9c-4258-b90f-a40d202b5050 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.1af6bbe6-0ed0-4e27-95b5-eb623da9b113 2G" returned: 0 in 0.449s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c337eaed-ff9c-4258-b90f-a40d202b5050 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.1af6bbe6-0ed0-4e27-95b5-eb623da9b113 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:13 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.1af6bbe6-0ed0-4e27-95b5-eb623da9b113 Jul 14 13:03:13 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:14 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4c839549-1550-4b1d-a0c8-7bc983ea214a tempest-VolumesDeleteCascade-1393361046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da223c1d-cca3-47a4-8d12-b3d02383288c" returned: 0 in 0.407s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4c839549-1550-4b1d-a0c8-7bc983ea214a tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da223c1d-cca3-47a4-8d12-b3d02383288c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:14 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da223c1d-cca3-47a4-8d12-b3d02383288c Jul 14 13:03:14 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:14 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c337eaed-ff9c-4258-b90f-a40d202b5050 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.1af6bbe6-0ed0-4e27-95b5-eb623da9b113" returned: 0 in 0.350s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:14 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-c337eaed-ff9c-4258-b90f-a40d202b5050 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.1af6bbe6-0ed0-4e27-95b5-eb623da9b113 is being set with open permissions: ugo+rw Jul 14 13:03:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c337eaed-ff9c-4258-b90f-a40d202b5050 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.1af6bbe6-0ed0-4e27-95b5-eb623da9b113 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:14 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.1af6bbe6-0ed0-4e27-95b5-eb623da9b113 Jul 14 13:03:14 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:14 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4c839549-1550-4b1d-a0c8-7bc983ea214a tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da223c1d-cca3-47a4-8d12-b3d02383288c" returned: 0 in 0.258s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4c839549-1550-4b1d-a0c8-7bc983ea214a tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-quobyte-da223c1d-cca3-47a4-8d12-b3d02383288c" released by "delete_volume" :: held 0.712s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:14 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c337eaed-ff9c-4258-b90f-a40d202b5050 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.1af6bbe6-0ed0-4e27-95b5-eb623da9b113" returned: 0 in 0.280s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:14 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-4c839549-1550-4b1d-a0c8-7bc983ea214a tempest-VolumesDeleteCascade-1393361046 None] Created reservations ['03152ae2-c1ff-41e9-bdaf-85adbbeaedfd', '0810d8ab-439f-46ab-aef1-6bf6bdc4b80b', '6c841a3b-475b-4675-ba22-3cd7df9ebe89', 'd1a41f9e-ab62-404a-bd7e-a410ca790d52'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c337eaed-ff9c-4258-b90f-a40d202b5050 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:14 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.info Jul 14 13:03:14 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4c839549-1550-4b1d-a0c8-7bc983ea214a tempest-VolumesDeleteCascade-1393361046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4c839549-1550-4b1d-a0c8-7bc983ea214a tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4c839549-1550-4b1d-a0c8-7bc983ea214a tempest-VolumesDeleteCascade-1393361046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4c839549-1550-4b1d-a0c8-7bc983ea214a tempest-VolumesDeleteCascade-1393361046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4c839549-1550-4b1d-a0c8-7bc983ea214a tempest-VolumesDeleteCascade-1393361046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4c839549-1550-4b1d-a0c8-7bc983ea214a tempest-VolumesDeleteCascade-1393361046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:14 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:03:14 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:14 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c337eaed-ff9c-4258-b90f-a40d202b5050 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.info" returned: 0 in 0.367s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:14 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-c337eaed-ff9c-4258-b90f-a40d202b5050 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.info is being set with open permissions: ugo+rw Jul 14 13:03:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c337eaed-ff9c-4258-b90f-a40d202b5050 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:14 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:14 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.info Jul 14 13:03:14 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4c839549-1550-4b1d-a0c8-7bc983ea214a tempest-VolumesDeleteCascade-1393361046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.374s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:14 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-4c839549-1550-4b1d-a0c8-7bc983ea214a tempest-VolumesDeleteCascade-1393361046 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:03:14 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-4c839549-1550-4b1d-a0c8-7bc983ea214a tempest-VolumesDeleteCascade-1393361046 None] Deleted volume successfully. Jul 14 13:03:14 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-37413feb-ee42-4291-9d69-90f54050f4bc req-23b4db33-13e4-4600-9b6c-403214988923 tempest-AttachVolumeNegativeTest-115818279 None] Terminate volume connection completed successfully. Jul 14 13:03:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-37413feb-ee42-4291-9d69-90f54050f4bc req-23b4db33-13e4-4600-9b6c-403214988923 tempest-AttachVolumeNegativeTest-115818279 None] Deleting attachment fc638a61-bb2c-4452-ab85-90af5a1b04b1. {{(pid=86977) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 13:03:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4c839549-1550-4b1d-a0c8-7bc983ea214a tempest-VolumesDeleteCascade-1393361046 None] Lock "cinder-da223c1d-cca3-47a4-8d12-b3d02383288c-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:15 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c337eaed-ff9c-4258-b90f-a40d202b5050 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.info" returned: 0 in 0.340s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c337eaed-ff9c-4258-b90f-a40d202b5050 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.340s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:15 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c337eaed-ff9c-4258-b90f-a40d202b5050 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Create snapshot completed successfully Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d8c0672e-be92-4841-a42e-c132f56480a6 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Acquiring lock "cinder-1af6bbe6-0ed0-4e27-95b5-eb623da9b113-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d8c0672e-be92-4841-a42e-c132f56480a6 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Lock "cinder-1af6bbe6-0ed0-4e27-95b5-eb623da9b113-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d8c0672e-be92-4841-a42e-c132f56480a6 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Acquiring lock "cinder-quobyte-66c9bda3-aaf3-4223-b74a-e5d34fb4c347" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d8c0672e-be92-4841-a42e-c132f56480a6 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Lock "cinder-quobyte-66c9bda3-aaf3-4223-b74a-e5d34fb4c347" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d8c0672e-be92-4841-a42e-c132f56480a6 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Acquiring lock "cinder-quobyte-1af6bbe6-0ed0-4e27-95b5-eb623da9b113" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d8c0672e-be92-4841-a42e-c132f56480a6 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Lock "cinder-quobyte-1af6bbe6-0ed0-4e27-95b5-eb623da9b113" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-d8c0672e-be92-4841-a42e-c132f56480a6 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Deleting offline snapshot 1af6bbe6-0ed0-4e27-95b5-eb623da9b113 of volume 66c9bda3-aaf3-4223-b74a-e5d34fb4c347 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-d8c0672e-be92-4841-a42e-c132f56480a6 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] snapshot_file for this snap is: volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.1af6bbe6-0ed0-4e27-95b5-eb623da9b113 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5725d66-2e33-4cf4-9176-aec859b5825c]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d8c0672e-be92-4841-a42e-c132f56480a6 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.1af6bbe6-0ed0-4e27-95b5-eb623da9b113 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:16 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.1af6bbe6-0ed0-4e27-95b5-eb623da9b113 Jul 14 13:03:16 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:16 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:03:16 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:16 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d8c0672e-be92-4841-a42e-c132f56480a6 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.1af6bbe6-0ed0-4e27-95b5-eb623da9b113" returned: 0 in 0.610s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-d8c0672e-be92-4841-a42e-c132f56480a6 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:03:16 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.415s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 28 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c6982f-a688-4d2c-ae78-45c774149f90]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d8c0672e-be92-4841-a42e-c132f56480a6 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:17 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347 Jul 14 13:03:17 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:17 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d8c0672e-be92-4841-a42e-c132f56480a6 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347" returned: 0 in 0.568s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d8c0672e-be92-4841-a42e-c132f56480a6 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.1af6bbe6-0ed0-4e27-95b5-eb623da9b113 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:17 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.1af6bbe6-0ed0-4e27-95b5-eb623da9b113 Jul 14 13:03:17 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:18 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d8c0672e-be92-4841-a42e-c132f56480a6 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.1af6bbe6-0ed0-4e27-95b5-eb623da9b113" returned: 0 in 0.642s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d8c0672e-be92-4841-a42e-c132f56480a6 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.1af6bbe6-0ed0-4e27-95b5-eb623da9b113 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:18 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.1af6bbe6-0ed0-4e27-95b5-eb623da9b113 Jul 14 13:03:18 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:18 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d8c0672e-be92-4841-a42e-c132f56480a6 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347.1af6bbe6-0ed0-4e27-95b5-eb623da9b113" returned: 0 in 0.401s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d8c0672e-be92-4841-a42e-c132f56480a6 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Lock "cinder-quobyte-1af6bbe6-0ed0-4e27-95b5-eb623da9b113" released by "_delete_snapshot" :: held 2.469s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d8c0672e-be92-4841-a42e-c132f56480a6 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Lock "cinder-quobyte-66c9bda3-aaf3-4223-b74a-e5d34fb4c347" released by "delete_snapshot" :: held 2.524s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:18 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-d8c0672e-be92-4841-a42e-c132f56480a6 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Created reservations ['edd84d93-dc4c-41f5-b95d-d92cdcbe1f65', 'ed875440-3de5-46e1-b4ea-2f0471adf393', 'fa70964f-8651-44a2-838a-c658e1a8657c', 'd8944446-0ab4-4e9a-ab3e-3b511cf0b423'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:18 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-d8c0672e-be92-4841-a42e-c132f56480a6 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Delete snapshot completed successfully. Jul 14 13:03:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d8c0672e-be92-4841-a42e-c132f56480a6 tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Lock "cinder-1af6bbe6-0ed0-4e27-95b5-eb623da9b113-delete_snapshot" released by "delete_snapshot" :: held 2.819s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-43d51a98-f3c0-446a-b3dd-5b6fe0623efc tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Acquiring lock "cinder-66c9bda3-aaf3-4223-b74a-e5d34fb4c347-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-43d51a98-f3c0-446a-b3dd-5b6fe0623efc tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Lock "cinder-66c9bda3-aaf3-4223-b74a-e5d34fb4c347-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-43d51a98-f3c0-446a-b3dd-5b6fe0623efc tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Acquiring lock "cinder-quobyte-66c9bda3-aaf3-4223-b74a-e5d34fb4c347" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-43d51a98-f3c0-446a-b3dd-5b6fe0623efc tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Lock "cinder-quobyte-66c9bda3-aaf3-4223-b74a-e5d34fb4c347" acquired by "delete_volume" :: waited 0.023s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:19 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d8ff20-32ce-41b2-ad54-8473da951a09]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-43d51a98-f3c0-446a-b3dd-5b6fe0623efc tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:19 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347 Jul 14 13:03:19 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:20 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-43d51a98-f3c0-446a-b3dd-5b6fe0623efc tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347" returned: 0 in 0.468s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-43d51a98-f3c0-446a-b3dd-5b6fe0623efc tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:20 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347 Jul 14 13:03:20 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:20 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-43d51a98-f3c0-446a-b3dd-5b6fe0623efc tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-66c9bda3-aaf3-4223-b74a-e5d34fb4c347" returned: 0 in 0.412s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-43d51a98-f3c0-446a-b3dd-5b6fe0623efc tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Lock "cinder-quobyte-66c9bda3-aaf3-4223-b74a-e5d34fb4c347" released by "delete_volume" :: held 0.962s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:20 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-43d51a98-f3c0-446a-b3dd-5b6fe0623efc tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Created reservations ['2aea10e0-394e-4901-be36-9df4aeb470fc', 'd1405e79-f929-4027-8187-89e92fa0075a', '27f4c2c8-c1a3-4d57-be10-7293c05042f4', 'd1b300ec-a792-4c52-a366-bc1aab3925fe'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-43d51a98-f3c0-446a-b3dd-5b6fe0623efc tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-43d51a98-f3c0-446a-b3dd-5b6fe0623efc tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-43d51a98-f3c0-446a-b3dd-5b6fe0623efc tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-43d51a98-f3c0-446a-b3dd-5b6fe0623efc tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-43d51a98-f3c0-446a-b3dd-5b6fe0623efc tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-43d51a98-f3c0-446a-b3dd-5b6fe0623efc tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:20 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:03:20 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:21 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-43d51a98-f3c0-446a-b3dd-5b6fe0623efc tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.340s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-43d51a98-f3c0-446a-b3dd-5b6fe0623efc tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:03:21 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-43d51a98-f3c0-446a-b3dd-5b6fe0623efc tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Deleted volume successfully. Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-43d51a98-f3c0-446a-b3dd-5b6fe0623efc tempest-VolumesSnapshotNegativeTestJSON-1382850561 None] Lock "cinder-66c9bda3-aaf3-4223-b74a-e5d34fb4c347-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Flow 'volume_create_manager' (f5e862ab-3d0b-48b0-9966-60c96879d7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d52cb1-d704-4212-b443-43f7b4da2ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-28009318-bbb8-4da3-92a4-eecab353d8f6 tempest-AttachVolumeNegativeTest-115818279 None] Acquiring lock "cinder-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d52cb1-d704-4212-b443-43f7b4da2ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1154796890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c47a30f8-95a0-43c0-a074-f342aea90d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117a6ecdc430471b8a117ef7978ac1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:22Z,use_quota=True,user_id='afb8102642e0462983fc3c8e3394e427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd1c314c-fb44-45cb-8251-6596f99e3d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd1c314c-fb44-45cb-8251-6596f99e3d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acfc73eb-df78-4edf-b91f-59ac439566db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acfc73eb-df78-4edf-b91f-59ac439566db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c47a30f8-95a0-43c0-a074-f342aea90d4f', 'volume_name': 'volume-c47a30f8-95a0-43c0-a074-f342aea90d4f', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ca3bde-8875-47c8-81ff-ae1bd37568be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ca3bde-8875-47c8-81ff-ae1bd37568be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fea39b-430f-4fb1-9925-cd0b51815f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:21 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Volume c47a30f8-95a0-43c0-a074-f342aea90d4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c47a30f8-95a0-43c0-a074-f342aea90d4f', 'volume_size': 1} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1154796890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c47a30f8-95a0-43c0-a074-f342aea90d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117a6ecdc430471b8a117ef7978ac1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:22Z,use_quota=True,user_id='afb8102642e0462983fc3c8e3394e427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Creating volume c47a30f8-95a0-43c0-a074-f342aea90d4f {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:03:21 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c47a30f8-95a0-43c0-a074-f342aea90d4f 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-28009318-bbb8-4da3-92a4-eecab353d8f6 tempest-AttachVolumeNegativeTest-115818279 None] Lock "cinder-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:21 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c47a30f8-95a0-43c0-a074-f342aea90d4f 1073741824 Jul 14 13:03:21 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-28009318-bbb8-4da3-92a4-eecab353d8f6 tempest-AttachVolumeNegativeTest-115818279 None] Acquiring lock "cinder-quobyte-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-28009318-bbb8-4da3-92a4-eecab353d8f6 tempest-AttachVolumeNegativeTest-115818279 None] Lock "cinder-quobyte-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4" acquired by "delete_volume" :: waited 0.026s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[666f9c85-5770-4172-8828-de5824d7b031]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-28009318-bbb8-4da3-92a4-eecab353d8f6 tempest-AttachVolumeNegativeTest-115818279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:22 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4 Jul 14 13:03:22 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6bb0fc98-8a9d-40ea-bd0c-1ed0649aa042 tempest-AttachVolumeShelveTestJSON-981611705 None] Acquiring lock "cinder-d8e3fcd4-5676-43ea-aecd-80042cefff9a-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6bb0fc98-8a9d-40ea-bd0c-1ed0649aa042 tempest-AttachVolumeShelveTestJSON-981611705 None] Lock "cinder-d8e3fcd4-5676-43ea-aecd-80042cefff9a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6bb0fc98-8a9d-40ea-bd0c-1ed0649aa042 tempest-AttachVolumeShelveTestJSON-981611705 None] Acquiring lock "cinder-quobyte-d8e3fcd4-5676-43ea-aecd-80042cefff9a" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6bb0fc98-8a9d-40ea-bd0c-1ed0649aa042 tempest-AttachVolumeShelveTestJSON-981611705 None] Lock "cinder-quobyte-d8e3fcd4-5676-43ea-aecd-80042cefff9a" acquired by "delete_volume" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23d7b5f-0b93-47b5-b058-c03dce644a0a]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6bb0fc98-8a9d-40ea-bd0c-1ed0649aa042 tempest-AttachVolumeShelveTestJSON-981611705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8e3fcd4-5676-43ea-aecd-80042cefff9a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:22 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-28009318-bbb8-4da3-92a4-eecab353d8f6 tempest-AttachVolumeNegativeTest-115818279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4" returned: 0 in 0.493s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-28009318-bbb8-4da3-92a4-eecab353d8f6 tempest-AttachVolumeNegativeTest-115818279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:22 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c47a30f8-95a0-43c0-a074-f342aea90d4f 1073741824" returned: 0 in 0.659s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:22 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4 Jul 14 13:03:22 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c47a30f8-95a0-43c0-a074-f342aea90d4f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:22 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c47a30f8-95a0-43c0-a074-f342aea90d4f Jul 14 13:03:22 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:22 devstack sudo[96721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8e3fcd4-5676-43ea-aecd-80042cefff9a Jul 14 13:03:22 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:22 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-28009318-bbb8-4da3-92a4-eecab353d8f6 tempest-AttachVolumeNegativeTest-115818279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4" returned: 0 in 0.311s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-28009318-bbb8-4da3-92a4-eecab353d8f6 tempest-AttachVolumeNegativeTest-115818279 None] Lock "cinder-quobyte-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4" released by "delete_volume" :: held 0.859s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:22 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:22 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6bb0fc98-8a9d-40ea-bd0c-1ed0649aa042 tempest-AttachVolumeShelveTestJSON-981611705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8e3fcd4-5676-43ea-aecd-80042cefff9a" returned: 0 in 0.441s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6bb0fc98-8a9d-40ea-bd0c-1ed0649aa042 tempest-AttachVolumeShelveTestJSON-981611705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8e3fcd4-5676-43ea-aecd-80042cefff9a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c47a30f8-95a0-43c0-a074-f342aea90d4f" returned: 0 in 0.382s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:22 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8e3fcd4-5676-43ea-aecd-80042cefff9a Jul 14 13:03:22 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fea39b-430f-4fb1-9925-cd0b51815f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c47a30f8-95a0-43c0-a074-f342aea90d4f', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e382aca0-126a-4a72-83ce-69baf0bb5382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-28009318-bbb8-4da3-92a4-eecab353d8f6 tempest-AttachVolumeNegativeTest-115818279 None] Created reservations ['fb21981e-4c9e-4083-8dfe-edb9ab769431', '286bfc78-02ed-490c-89a1-85f34bad1dba', '5f477224-7c52-4fdd-91a3-bf8e4802990d', '6d65096b-ba15-48e2-9002-d07f07a41e1f'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:22 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Volume volume-c47a30f8-95a0-43c0-a074-f342aea90d4f (c47a30f8-95a0-43c0-a074-f342aea90d4f): created successfully Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e382aca0-126a-4a72-83ce-69baf0bb5382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Flow 'volume_create_manager' (f5e862ab-3d0b-48b0-9966-60c96879d7c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:22 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-2756dc63-5d1f-4d0a-b824-8d6f44a24c9d tempest-VolumesTransfersV357Test-256317662 None] Created volume successfully. Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-28009318-bbb8-4da3-92a4-eecab353d8f6 tempest-AttachVolumeNegativeTest-115818279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-28009318-bbb8-4da3-92a4-eecab353d8f6 tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-28009318-bbb8-4da3-92a4-eecab353d8f6 tempest-AttachVolumeNegativeTest-115818279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-28009318-bbb8-4da3-92a4-eecab353d8f6 tempest-AttachVolumeNegativeTest-115818279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-28009318-bbb8-4da3-92a4-eecab353d8f6 tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-28009318-bbb8-4da3-92a4-eecab353d8f6 tempest-AttachVolumeNegativeTest-115818279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:23 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:03:23 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:23 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6bb0fc98-8a9d-40ea-bd0c-1ed0649aa042 tempest-AttachVolumeShelveTestJSON-981611705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d8e3fcd4-5676-43ea-aecd-80042cefff9a" returned: 0 in 0.277s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6bb0fc98-8a9d-40ea-bd0c-1ed0649aa042 tempest-AttachVolumeShelveTestJSON-981611705 None] Lock "cinder-quobyte-d8e3fcd4-5676-43ea-aecd-80042cefff9a" released by "delete_volume" :: held 0.790s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:23 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-6bb0fc98-8a9d-40ea-bd0c-1ed0649aa042 tempest-AttachVolumeShelveTestJSON-981611705 None] Created reservations ['dbf5c6ee-6a0d-432a-bef5-81c8c76fcbca', '8213f2f2-7085-4255-afe9-dd1bafdc11d2', '185d0f1f-2bf4-4560-a808-55203370da8a', 'd1991008-fec3-485f-94b6-ed14bdb0c971'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6bb0fc98-8a9d-40ea-bd0c-1ed0649aa042 tempest-AttachVolumeShelveTestJSON-981611705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6bb0fc98-8a9d-40ea-bd0c-1ed0649aa042 tempest-AttachVolumeShelveTestJSON-981611705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6bb0fc98-8a9d-40ea-bd0c-1ed0649aa042 tempest-AttachVolumeShelveTestJSON-981611705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6bb0fc98-8a9d-40ea-bd0c-1ed0649aa042 tempest-AttachVolumeShelveTestJSON-981611705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6bb0fc98-8a9d-40ea-bd0c-1ed0649aa042 tempest-AttachVolumeShelveTestJSON-981611705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:23 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6bb0fc98-8a9d-40ea-bd0c-1ed0649aa042 tempest-AttachVolumeShelveTestJSON-981611705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-28009318-bbb8-4da3-92a4-eecab353d8f6 tempest-AttachVolumeNegativeTest-115818279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.286s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:23 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-28009318-bbb8-4da3-92a4-eecab353d8f6 tempest-AttachVolumeNegativeTest-115818279 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:03:23 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-28009318-bbb8-4da3-92a4-eecab353d8f6 tempest-AttachVolumeNegativeTest-115818279 None] Deleted volume successfully. Jul 14 13:03:23 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:03:23 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-28009318-bbb8-4da3-92a4-eecab353d8f6 tempest-AttachVolumeNegativeTest-115818279 None] Lock "cinder-fce4c97a-aa5f-4ad0-84c7-e8352e4bb3d4-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:23 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6bb0fc98-8a9d-40ea-bd0c-1ed0649aa042 tempest-AttachVolumeShelveTestJSON-981611705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.297s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:23 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-6bb0fc98-8a9d-40ea-bd0c-1ed0649aa042 tempest-AttachVolumeShelveTestJSON-981611705 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:03:23 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-6bb0fc98-8a9d-40ea-bd0c-1ed0649aa042 tempest-AttachVolumeShelveTestJSON-981611705 None] Deleted volume successfully. Jul 14 13:03:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6bb0fc98-8a9d-40ea-bd0c-1ed0649aa042 tempest-AttachVolumeShelveTestJSON-981611705 None] Lock "cinder-d8e3fcd4-5676-43ea-aecd-80042cefff9a-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a42c1194-7f28-4703-bafd-d643bb81808e tempest-AttachVolumeNegativeTest-115818279 None] Acquiring lock "cinder-b8714d82-1ff7-41a6-a16d-dbd011729c34-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a42c1194-7f28-4703-bafd-d643bb81808e tempest-AttachVolumeNegativeTest-115818279 None] Lock "cinder-b8714d82-1ff7-41a6-a16d-dbd011729c34-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a42c1194-7f28-4703-bafd-d643bb81808e tempest-AttachVolumeNegativeTest-115818279 None] Acquiring lock "cinder-quobyte-b8714d82-1ff7-41a6-a16d-dbd011729c34" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a42c1194-7f28-4703-bafd-d643bb81808e tempest-AttachVolumeNegativeTest-115818279 None] Lock "cinder-quobyte-b8714d82-1ff7-41a6-a16d-dbd011729c34" acquired by "delete_volume" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:24 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[32961f34-7509-4965-9884-06900200fa37]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a42c1194-7f28-4703-bafd-d643bb81808e tempest-AttachVolumeNegativeTest-115818279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b8714d82-1ff7-41a6-a16d-dbd011729c34 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:24 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b8714d82-1ff7-41a6-a16d-dbd011729c34 Jul 14 13:03:24 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:24 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a42c1194-7f28-4703-bafd-d643bb81808e tempest-AttachVolumeNegativeTest-115818279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b8714d82-1ff7-41a6-a16d-dbd011729c34" returned: 0 in 0.460s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a42c1194-7f28-4703-bafd-d643bb81808e tempest-AttachVolumeNegativeTest-115818279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b8714d82-1ff7-41a6-a16d-dbd011729c34 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:24 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b8714d82-1ff7-41a6-a16d-dbd011729c34 Jul 14 13:03:24 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:24 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-df7ddb96-1fbe-483e-9454-ff5d2d9d9939 tempest-VolumesTransfersV357Test-409207074 None] Transfer volume completed successfully. Jul 14 13:03:25 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a42c1194-7f28-4703-bafd-d643bb81808e tempest-AttachVolumeNegativeTest-115818279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b8714d82-1ff7-41a6-a16d-dbd011729c34" returned: 0 in 0.358s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a42c1194-7f28-4703-bafd-d643bb81808e tempest-AttachVolumeNegativeTest-115818279 None] Lock "cinder-quobyte-b8714d82-1ff7-41a6-a16d-dbd011729c34" released by "delete_volume" :: held 0.874s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-a42c1194-7f28-4703-bafd-d643bb81808e tempest-AttachVolumeNegativeTest-115818279 None] Created reservations ['f05a7145-4488-4ab1-9546-f924a4f94751', '3d23b2fd-047c-4fc0-83ec-5a5c7e32a4db', 'd062087a-99a3-42b6-861c-7abacb0d2cb8', '332f7d0e-deda-416d-99d8-79bdbd256369'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a42c1194-7f28-4703-bafd-d643bb81808e tempest-AttachVolumeNegativeTest-115818279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a42c1194-7f28-4703-bafd-d643bb81808e tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a42c1194-7f28-4703-bafd-d643bb81808e tempest-AttachVolumeNegativeTest-115818279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a42c1194-7f28-4703-bafd-d643bb81808e tempest-AttachVolumeNegativeTest-115818279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a42c1194-7f28-4703-bafd-d643bb81808e tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a42c1194-7f28-4703-bafd-d643bb81808e tempest-AttachVolumeNegativeTest-115818279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:25 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:03:25 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-54f3b152-5acc-4d08-84a9-ab3b0c2a00bf tempest-VolumesTransfersV357Test-971958946 None] Acquiring lock "cinder-c47a30f8-95a0-43c0-a074-f342aea90d4f-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:25 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a42c1194-7f28-4703-bafd-d643bb81808e tempest-AttachVolumeNegativeTest-115818279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.328s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-a42c1194-7f28-4703-bafd-d643bb81808e tempest-AttachVolumeNegativeTest-115818279 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-54f3b152-5acc-4d08-84a9-ab3b0c2a00bf tempest-VolumesTransfersV357Test-971958946 None] Lock "cinder-c47a30f8-95a0-43c0-a074-f342aea90d4f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:25 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-a42c1194-7f28-4703-bafd-d643bb81808e tempest-AttachVolumeNegativeTest-115818279 None] Deleted volume successfully. Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Flow 'volume_create_manager' (9f2c5808-6e1b-4e82-b40f-e2e7b5b298da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c28bcb7-b343-4283-b710-4d6554ef34c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c28bcb7-b343-4283-b710-4d6554ef34c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-419922214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e843c7b44a1a49e0bbf709f860211dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:26Z,use_quota=True,user_id='ed8594f117ad4ee4898d9d5d774d844a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afbdaf95-e1ca-4916-9af8-daa9fff87113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afbdaf95-e1ca-4916-9af8-daa9fff87113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f3dbf1-f466-409f-a28b-89c2fd49b00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f3dbf1-f466-409f-a28b-89c2fd49b00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7', 'volume_name': 'volume-a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff596c6-d8fc-4407-80be-39fc31f823e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff596c6-d8fc-4407-80be-39fc31f823e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e269967-0dab-42af-9e90-3edf85e58376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:25 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Volume a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7', 'volume_size': 1} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-419922214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e843c7b44a1a49e0bbf709f860211dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:26Z,use_quota=True,user_id='ed8594f117ad4ee4898d9d5d774d844a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Creating volume a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:03:25 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a5301d2c-b83c-4044-ad71-5878bf625e53 tempest-AttachVolumeNegativeTest-115818279 None] Acquiring lock "cinder-64442ee3-d4db-4959-b6f5-470f1d189f7d-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-54f3b152-5acc-4d08-84a9-ab3b0c2a00bf tempest-VolumesTransfersV357Test-971958946 None] Acquiring lock "cinder-quobyte-c47a30f8-95a0-43c0-a074-f342aea90d4f" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:25 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7 1073741824 Jul 14 13:03:25 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a42c1194-7f28-4703-bafd-d643bb81808e tempest-AttachVolumeNegativeTest-115818279 None] Lock "cinder-b8714d82-1ff7-41a6-a16d-dbd011729c34-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a5301d2c-b83c-4044-ad71-5878bf625e53 tempest-AttachVolumeNegativeTest-115818279 None] Lock "cinder-64442ee3-d4db-4959-b6f5-470f1d189f7d-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-54f3b152-5acc-4d08-84a9-ab3b0c2a00bf tempest-VolumesTransfersV357Test-971958946 None] Lock "cinder-quobyte-c47a30f8-95a0-43c0-a074-f342aea90d4f" acquired by "delete_volume" :: waited 0.055s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[492d255c-78df-4bce-ba07-36b54b8589f6]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-54f3b152-5acc-4d08-84a9-ab3b0c2a00bf tempest-VolumesTransfersV357Test-971958946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c47a30f8-95a0-43c0-a074-f342aea90d4f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a5301d2c-b83c-4044-ad71-5878bf625e53 tempest-AttachVolumeNegativeTest-115818279 None] Acquiring lock "cinder-quobyte-64442ee3-d4db-4959-b6f5-470f1d189f7d" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a5301d2c-b83c-4044-ad71-5878bf625e53 tempest-AttachVolumeNegativeTest-115818279 None] Lock "cinder-quobyte-64442ee3-d4db-4959-b6f5-470f1d189f7d" acquired by "delete_volume" :: waited 0.032s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c2f9fc-544d-4236-8295-a9bb59bc998e]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a5301d2c-b83c-4044-ad71-5878bf625e53 tempest-AttachVolumeNegativeTest-115818279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-64442ee3-d4db-4959-b6f5-470f1d189f7d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:03:26 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c47a30f8-95a0-43c0-a074-f342aea90d4f Jul 14 13:03:26 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Flow 'volume_create_manager' (2fdca088-2a6b-4ac9-b83e-f94b81b97b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1dd5465-b754-42df-8ad0-16a26825d747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:26 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-64442ee3-d4db-4959-b6f5-470f1d189f7d Jul 14 13:03:26 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1dd5465-b754-42df-8ad0-16a26825d747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1683934152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd223ad1-0157-4c24-8ee7-270ebfe3db3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e843c7b44a1a49e0bbf709f860211dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:26Z,use_quota=True,user_id='ed8594f117ad4ee4898d9d5d774d844a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f2bf222-a2e7-4071-9c49-c62f37191796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f2bf222-a2e7-4071-9c49-c62f37191796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d30f9635-5bbb-4490-b8dc-bccc652956d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d30f9635-5bbb-4490-b8dc-bccc652956d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd223ad1-0157-4c24-8ee7-270ebfe3db3b', 'volume_name': 'volume-dd223ad1-0157-4c24-8ee7-270ebfe3db3b', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb63402-3cae-4267-bb70-0f227d06d35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb63402-3cae-4267-bb70-0f227d06d35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d731cc6d-545e-49b8-aaf4-491a4017778c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:26 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Volume dd223ad1-0157-4c24-8ee7-270ebfe3db3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd223ad1-0157-4c24-8ee7-270ebfe3db3b', 'volume_size': 1} Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:26 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7 1073741824" returned: 0 in 0.800s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:26 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-54f3b152-5acc-4d08-84a9-ab3b0c2a00bf tempest-VolumesTransfersV357Test-971958946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c47a30f8-95a0-43c0-a074-f342aea90d4f" returned: 0 in 0.666s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-54f3b152-5acc-4d08-84a9-ab3b0c2a00bf tempest-VolumesTransfersV357Test-971958946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c47a30f8-95a0-43c0-a074-f342aea90d4f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:26 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c47a30f8-95a0-43c0-a074-f342aea90d4f Jul 14 13:03:26 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:26 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a5301d2c-b83c-4044-ad71-5878bf625e53 tempest-AttachVolumeNegativeTest-115818279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-64442ee3-d4db-4959-b6f5-470f1d189f7d" returned: 0 in 0.641s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a5301d2c-b83c-4044-ad71-5878bf625e53 tempest-AttachVolumeNegativeTest-115818279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-64442ee3-d4db-4959-b6f5-470f1d189f7d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:26 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-64442ee3-d4db-4959-b6f5-470f1d189f7d Jul 14 13:03:26 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:26 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7 Jul 14 13:03:26 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Flow 'volume_create_manager' (be7f7c6f-1519-4ff9-9579-9f4f1e92f675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b13774c-8802-4281-bed5-87a6c72be21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b13774c-8802-4281-bed5-87a6c72be21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-179340655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=157cae33-5977-42cb-971a-93c3ad8ad1b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e843c7b44a1a49e0bbf709f860211dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:27Z,use_quota=True,user_id='ed8594f117ad4ee4898d9d5d774d844a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e10201-ad9d-4930-b08a-34c9e2802f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e10201-ad9d-4930-b08a-34c9e2802f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427775cd-4918-4d00-b385-cbbfc9a2ec41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427775cd-4918-4d00-b385-cbbfc9a2ec41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '157cae33-5977-42cb-971a-93c3ad8ad1b5', 'volume_name': 'volume-157cae33-5977-42cb-971a-93c3ad8ad1b5', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e2a913-c3a9-4025-a8a7-db5e437fea4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e2a913-c3a9-4025-a8a7-db5e437fea4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f74f9a8-622b-41af-8ccc-cd30909f2886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:27 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Volume 157cae33-5977-42cb-971a-93c3ad8ad1b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-157cae33-5977-42cb-971a-93c3ad8ad1b5', 'volume_size': 1} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:27 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a5301d2c-b83c-4044-ad71-5878bf625e53 tempest-AttachVolumeNegativeTest-115818279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-64442ee3-d4db-4959-b6f5-470f1d189f7d" returned: 0 in 0.416s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a5301d2c-b83c-4044-ad71-5878bf625e53 tempest-AttachVolumeNegativeTest-115818279 None] Lock "cinder-quobyte-64442ee3-d4db-4959-b6f5-470f1d189f7d" released by "delete_volume" :: held 1.156s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:27 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-54f3b152-5acc-4d08-84a9-ab3b0c2a00bf tempest-VolumesTransfersV357Test-971958946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c47a30f8-95a0-43c0-a074-f342aea90d4f" returned: 0 in 0.570s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-54f3b152-5acc-4d08-84a9-ab3b0c2a00bf tempest-VolumesTransfersV357Test-971958946 None] Lock "cinder-quobyte-c47a30f8-95a0-43c0-a074-f342aea90d4f" released by "delete_volume" :: held 1.332s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:27 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7" returned: 0 in 0.585s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.048s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1683934152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd223ad1-0157-4c24-8ee7-270ebfe3db3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e843c7b44a1a49e0bbf709f860211dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:26Z,use_quota=True,user_id='ed8594f117ad4ee4898d9d5d774d844a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Creating volume dd223ad1-0157-4c24-8ee7-270ebfe3db3b {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:03:27 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd223ad1-0157-4c24-8ee7-270ebfe3db3b 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:27 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd223ad1-0157-4c24-8ee7-270ebfe3db3b 1073741824 Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-a5301d2c-b83c-4044-ad71-5878bf625e53 tempest-AttachVolumeNegativeTest-115818279 None] Created reservations ['d1365e66-8fa1-4073-acb3-6958f2e9e8b6', '710d30df-a3fd-4fcb-a77b-1daf439d78f9', 'e1640dc7-3a9e-4235-b4a8-1a533c7d47c7', '8297d625-ed98-4335-b70a-8b5f29896f98'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:27 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e269967-0dab-42af-9e90-3edf85e58376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c8969e-055c-43ab-ae85-d7ea052ec1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-54f3b152-5acc-4d08-84a9-ab3b0c2a00bf tempest-VolumesTransfersV357Test-971958946 None] Created reservations ['4796a3d8-72d1-4091-ab88-ba76dabaa175', 'ae7a12bb-2ad0-445d-a3e8-29169bf55fbf', '78010df6-b2ac-4fbd-9247-af1c0092e8e8', '8bae4dc9-31b8-4ce0-ab9f-19fa5c0361ce'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:27 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Volume volume-a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7 (a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7): created successfully Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c8969e-055c-43ab-ae85-d7ea052ec1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Flow 'volume_create_manager' (9f2c5808-6e1b-4e82-b40f-e2e7b5b298da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:27 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-3c6c6618-dc03-42fa-91a7-f523b3767cc4 tempest-CreateVolumesFromImageTest-1319361619 None] Created volume successfully. Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Flow 'volume_create_manager' (c8c16fdf-425e-4383-97b8-0541ac764a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d4b4a5b-2e01-4417-af4a-a7891032ac7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d4b4a5b-2e01-4417-af4a-a7891032ac7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1138566129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231f6e48-ab4c-4975-81af-b8df291ec473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e843c7b44a1a49e0bbf709f860211dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:28Z,use_quota=True,user_id='ed8594f117ad4ee4898d9d5d774d844a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47bf1af7-8321-4ed8-ba22-678583cfdbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47bf1af7-8321-4ed8-ba22-678583cfdbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb18975f-133e-4399-ad31-9e160bac559e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb18975f-133e-4399-ad31-9e160bac559e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '231f6e48-ab4c-4975-81af-b8df291ec473', 'volume_name': 'volume-231f6e48-ab4c-4975-81af-b8df291ec473', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7f5653-e4c0-4ac9-913d-3d972b748f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7f5653-e4c0-4ac9-913d-3d972b748f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e51c16-7c37-4a85-b328-b8c63c0d7781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:27 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Volume 231f6e48-ab4c-4975-81af-b8df291ec473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-231f6e48-ab4c-4975-81af-b8df291ec473', 'volume_size': 1} Jul 14 13:03:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-54f3b152-5acc-4d08-84a9-ab3b0c2a00bf tempest-VolumesTransfersV357Test-971958946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-54f3b152-5acc-4d08-84a9-ab3b0c2a00bf tempest-VolumesTransfersV357Test-971958946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-54f3b152-5acc-4d08-84a9-ab3b0c2a00bf tempest-VolumesTransfersV357Test-971958946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-54f3b152-5acc-4d08-84a9-ab3b0c2a00bf tempest-VolumesTransfersV357Test-971958946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-54f3b152-5acc-4d08-84a9-ab3b0c2a00bf tempest-VolumesTransfersV357Test-971958946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-54f3b152-5acc-4d08-84a9-ab3b0c2a00bf tempest-VolumesTransfersV357Test-971958946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a5301d2c-b83c-4044-ad71-5878bf625e53 tempest-AttachVolumeNegativeTest-115818279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a5301d2c-b83c-4044-ad71-5878bf625e53 tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a5301d2c-b83c-4044-ad71-5878bf625e53 tempest-AttachVolumeNegativeTest-115818279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:28 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a5301d2c-b83c-4044-ad71-5878bf625e53 tempest-AttachVolumeNegativeTest-115818279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a5301d2c-b83c-4044-ad71-5878bf625e53 tempest-AttachVolumeNegativeTest-115818279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a5301d2c-b83c-4044-ad71-5878bf625e53 tempest-AttachVolumeNegativeTest-115818279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:28 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:28 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:03:28 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:03:28 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Flow 'volume_create_manager' (4e283ebf-1a29-4710-99a2-035e9c491d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccdef1f-a3f0-4057-9c91-6f67c1bc537e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd223ad1-0157-4c24-8ee7-270ebfe3db3b 1073741824" returned: 0 in 0.936s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:28 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccdef1f-a3f0-4057-9c91-6f67c1bc537e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-582320916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956b86c3-c711-4765-8e15-dcb67313a3e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e843c7b44a1a49e0bbf709f860211dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:28Z,use_quota=True,user_id='ed8594f117ad4ee4898d9d5d774d844a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32dab4cc-cb0c-4061-a8af-100f7cbd6d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32dab4cc-cb0c-4061-a8af-100f7cbd6d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85073c22-1984-4425-86a3-54c7b29bacb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85073c22-1984-4425-86a3-54c7b29bacb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '956b86c3-c711-4765-8e15-dcb67313a3e5', 'volume_name': 'volume-956b86c3-c711-4765-8e15-dcb67313a3e5', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8280df8d-cdd3-4b31-8dec-af2c70368a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8280df8d-cdd3-4b31-8dec-af2c70368a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add78e4e-aa72-4c8e-b31c-4281a2a325b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:28 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Volume 956b86c3-c711-4765-8e15-dcb67313a3e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-956b86c3-c711-4765-8e15-dcb67313a3e5', 'volume_size': 1} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-54f3b152-5acc-4d08-84a9-ab3b0c2a00bf tempest-VolumesTransfersV357Test-971958946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.601s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-54f3b152-5acc-4d08-84a9-ab3b0c2a00bf tempest-VolumesTransfersV357Test-971958946 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:03:28 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-54f3b152-5acc-4d08-84a9-ab3b0c2a00bf tempest-VolumesTransfersV357Test-971958946 None] Deleted volume successfully. Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd223ad1-0157-4c24-8ee7-270ebfe3db3b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:28 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-54f3b152-5acc-4d08-84a9-ab3b0c2a00bf tempest-VolumesTransfersV357Test-971958946 None] Lock "cinder-c47a30f8-95a0-43c0-a074-f342aea90d4f-delete_volume" released by "delete_volume" :: held 3.055s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a5301d2c-b83c-4044-ad71-5878bf625e53 tempest-AttachVolumeNegativeTest-115818279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.611s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-a5301d2c-b83c-4044-ad71-5878bf625e53 tempest-AttachVolumeNegativeTest-115818279 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:03:28 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd223ad1-0157-4c24-8ee7-270ebfe3db3b Jul 14 13:03:28 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:28 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-a5301d2c-b83c-4044-ad71-5878bf625e53 tempest-AttachVolumeNegativeTest-115818279 None] Deleted volume successfully. Jul 14 13:03:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a5301d2c-b83c-4044-ad71-5878bf625e53 tempest-AttachVolumeNegativeTest-115818279 None] Lock "cinder-64442ee3-d4db-4959-b6f5-470f1d189f7d-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:29 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd223ad1-0157-4c24-8ee7-270ebfe3db3b" returned: 0 in 0.345s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.775s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-179340655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=157cae33-5977-42cb-971a-93c3ad8ad1b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e843c7b44a1a49e0bbf709f860211dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:27Z,use_quota=True,user_id='ed8594f117ad4ee4898d9d5d774d844a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Creating volume 157cae33-5977-42cb-971a-93c3ad8ad1b5 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:03:29 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-157cae33-5977-42cb-971a-93c3ad8ad1b5 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:03:29 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-157cae33-5977-42cb-971a-93c3ad8ad1b5 1073741824 Jul 14 13:03:29 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Flow 'volume_create_manager' (5124e3ed-d1ef-4f2d-8fca-b9aa23a4dc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f90e33c-b7b9-462c-9f1c-18b68e22dedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d731cc6d-545e-49b8-aaf4-491a4017778c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd223ad1-0157-4c24-8ee7-270ebfe3db3b', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7c7da01-a22f-4392-b8fd-ede212f905f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f90e33c-b7b9-462c-9f1c-18b68e22dedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1204980660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117a6ecdc430471b8a117ef7978ac1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:29Z,use_quota=True,user_id='afb8102642e0462983fc3c8e3394e427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe6bb34-1344-4483-a204-292e5884959f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe6bb34-1344-4483-a204-292e5884959f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32392578-bb4d-4bc5-92f4-999ac5e72cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32392578-bb4d-4bc5-92f4-999ac5e72cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4', 'volume_name': 'volume-ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e36e915-9dee-4811-baef-22509b3d4756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e36e915-9dee-4811-baef-22509b3d4756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a6f83c-0205-4f9c-8d43-7f1c2076f89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:29 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Volume ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4', 'volume_size': 1} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:29 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Volume volume-dd223ad1-0157-4c24-8ee7-270ebfe3db3b (dd223ad1-0157-4c24-8ee7-270ebfe3db3b): created successfully Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7c7da01-a22f-4392-b8fd-ede212f905f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Flow 'volume_create_manager' (2fdca088-2a6b-4ac9-b83e-f94b81b97b29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:29 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-d526e4e3-1c41-4184-9499-80323eeb1a21 tempest-CreateVolumesFromImageTest-1319361619 None] Created volume successfully. Jul 14 13:03:29 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-157cae33-5977-42cb-971a-93c3ad8ad1b5 1073741824" returned: 0 in 0.512s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-157cae33-5977-42cb-971a-93c3ad8ad1b5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:29 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-157cae33-5977-42cb-971a-93c3ad8ad1b5 Jul 14 13:03:29 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:29 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-157cae33-5977-42cb-971a-93c3ad8ad1b5" returned: 0 in 0.324s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.946s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1138566129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231f6e48-ab4c-4975-81af-b8df291ec473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e843c7b44a1a49e0bbf709f860211dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:28Z,use_quota=True,user_id='ed8594f117ad4ee4898d9d5d774d844a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Creating volume 231f6e48-ab4c-4975-81af-b8df291ec473 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:03:29 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-231f6e48-ab4c-4975-81af-b8df291ec473 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f74f9a8-622b-41af-8ccc-cd30909f2886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-157cae33-5977-42cb-971a-93c3ad8ad1b5', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (458f774c-a60b-4d99-9e48-b6dd7fb1f5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:29 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-231f6e48-ab4c-4975-81af-b8df291ec473 1073741824 Jul 14 13:03:29 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:29 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Volume volume-157cae33-5977-42cb-971a-93c3ad8ad1b5 (157cae33-5977-42cb-971a-93c3ad8ad1b5): created successfully Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (458f774c-a60b-4d99-9e48-b6dd7fb1f5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Flow 'volume_create_manager' (be7f7c6f-1519-4ff9-9579-9f4f1e92f675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:30 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-84eade3e-067b-4779-af45-8980c6f9594f tempest-CreateVolumesFromImageTest-1319361619 None] Created volume successfully. Jul 14 13:03:30 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-231f6e48-ab4c-4975-81af-b8df291ec473 1073741824" returned: 0 in 0.615s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-231f6e48-ab4c-4975-81af-b8df291ec473 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:30 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-231f6e48-ab4c-4975-81af-b8df291ec473 Jul 14 13:03:30 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:30 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-231f6e48-ab4c-4975-81af-b8df291ec473" returned: 0 in 0.244s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:03:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.210s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-582320916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956b86c3-c711-4765-8e15-dcb67313a3e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e843c7b44a1a49e0bbf709f860211dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:28Z,use_quota=True,user_id='ed8594f117ad4ee4898d9d5d774d844a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:03:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Creating volume 956b86c3-c711-4765-8e15-dcb67313a3e5 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:03:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:03:30 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:03:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-956b86c3-c711-4765-8e15-dcb67313a3e5 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e51c16-7c37-4a85-b328-b8c63c0d7781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-231f6e48-ab4c-4975-81af-b8df291ec473', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8917c144-1218-4f63-aae8-d146ae690e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:30 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-956b86c3-c711-4765-8e15-dcb67313a3e5 1073741824 Jul 14 13:03:30 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:30 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Volume volume-231f6e48-ab4c-4975-81af-b8df291ec473 (231f6e48-ab4c-4975-81af-b8df291ec473): created successfully Jul 14 13:03:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8917c144-1218-4f63-aae8-d146ae690e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Flow 'volume_create_manager' (c8c16fdf-425e-4383-97b8-0541ac764a86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:30 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-734ca332-568f-4e83-8dee-0a0ba7eceb12 tempest-CreateVolumesFromImageTest-1319361619 None] Created volume successfully. Jul 14 13:03:31 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-956b86c3-c711-4765-8e15-dcb67313a3e5 1073741824" returned: 0 in 0.520s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-956b86c3-c711-4765-8e15-dcb67313a3e5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:31 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-956b86c3-c711-4765-8e15-dcb67313a3e5 Jul 14 13:03:31 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:31 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-956b86c3-c711-4765-8e15-dcb67313a3e5" returned: 0 in 0.295s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:31 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:03:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.395s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:31 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1204980660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117a6ecdc430471b8a117ef7978ac1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:29Z,use_quota=True,user_id='afb8102642e0462983fc3c8e3394e427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:03:31 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Creating volume ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:03:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:31 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:31 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:31 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:03:31 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:03:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:31 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add78e4e-aa72-4c8e-b31c-4281a2a325b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-956b86c3-c711-4765-8e15-dcb67313a3e5', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:31 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4 1073741824 Jul 14 13:03:31 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:31 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebbfc98-fc87-4e73-ad23-33efdb8b9605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:31 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Volume volume-956b86c3-c711-4765-8e15-dcb67313a3e5 (956b86c3-c711-4765-8e15-dcb67313a3e5): created successfully Jul 14 13:03:31 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebbfc98-fc87-4e73-ad23-33efdb8b9605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:31 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Flow 'volume_create_manager' (4e283ebf-1a29-4710-99a2-035e9c491d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:31 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-659d9f74-f732-4cca-a7c4-1db72219d85b tempest-CreateVolumesFromImageTest-1319361619 None] Created volume successfully. Jul 14 13:03:32 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4 1073741824" returned: 0 in 0.584s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:32 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4 Jul 14 13:03:32 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:32 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4" returned: 0 in 0.303s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:32 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:03:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a6f83c-0205-4f9c-8d43-7f1c2076f89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0217db-bcb8-48dc-9589-5a7e1b25e113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:32 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Volume volume-ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4 (ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4): created successfully Jul 14 13:03:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0217db-bcb8-48dc-9589-5a7e1b25e113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Flow 'volume_create_manager' (5124e3ed-d1ef-4f2d-8fca-b9aa23a4dc89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:32 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-72174e57-07af-4648-b083-cee43baee696 tempest-VolumesTransfersV357Test-256317662 None] Created volume successfully. Jul 14 13:03:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6655e2e0-ddde-49eb-9287-b10cb372f3c2 tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "cinder-956b86c3-c711-4765-8e15-dcb67313a3e5-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6655e2e0-ddde-49eb-9287-b10cb372f3c2 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "cinder-956b86c3-c711-4765-8e15-dcb67313a3e5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6655e2e0-ddde-49eb-9287-b10cb372f3c2 tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "cinder-quobyte-956b86c3-c711-4765-8e15-dcb67313a3e5" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6655e2e0-ddde-49eb-9287-b10cb372f3c2 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "cinder-quobyte-956b86c3-c711-4765-8e15-dcb67313a3e5" acquired by "delete_volume" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:32 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c49d420-5f9b-4dc9-914e-e5c6193c24e8]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6655e2e0-ddde-49eb-9287-b10cb372f3c2 tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-956b86c3-c711-4765-8e15-dcb67313a3e5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:33 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-956b86c3-c711-4765-8e15-dcb67313a3e5 Jul 14 13:03:33 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:33 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-65c5a5e2-3e68-4462-953d-0b91fcba9c1a tempest-GroupsV314Test-393283468 None] Group tempest-GroupsV314Test-Group-1266532682: creating Jul 14 13:03:33 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-65c5a5e2-3e68-4462-953d-0b91fcba9c1a tempest-GroupsV314Test-393283468 None] Group tempest-GroupsV314Test-Group-1266532682: created successfully Jul 14 13:03:33 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-65c5a5e2-3e68-4462-953d-0b91fcba9c1a tempest-GroupsV314Test-393283468 None] Create group completed successfully. Jul 14 13:03:33 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6655e2e0-ddde-49eb-9287-b10cb372f3c2 tempest-CreateVolumesFromImageTest-1319361619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-956b86c3-c711-4765-8e15-dcb67313a3e5" returned: 0 in 0.507s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6655e2e0-ddde-49eb-9287-b10cb372f3c2 tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-956b86c3-c711-4765-8e15-dcb67313a3e5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:33 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-956b86c3-c711-4765-8e15-dcb67313a3e5 Jul 14 13:03:33 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-613d32bd-640b-4091-a926-b6ec0ec429cb tempest-VolumesTransfersV357Test-971958946 None] Acquiring lock "cinder-ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-613d32bd-640b-4091-a926-b6ec0ec429cb tempest-VolumesTransfersV357Test-971958946 None] Lock "cinder-ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-613d32bd-640b-4091-a926-b6ec0ec429cb tempest-VolumesTransfersV357Test-971958946 None] Acquiring lock "cinder-quobyte-ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-613d32bd-640b-4091-a926-b6ec0ec429cb tempest-VolumesTransfersV357Test-971958946 None] Lock "cinder-quobyte-ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4" acquired by "delete_volume" :: waited 0.020s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:33 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfe178c-6962-49b2-a76e-ee8e10a04a89]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-613d32bd-640b-4091-a926-b6ec0ec429cb tempest-VolumesTransfersV357Test-971958946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:33 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4 Jul 14 13:03:33 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:33 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6655e2e0-ddde-49eb-9287-b10cb372f3c2 tempest-CreateVolumesFromImageTest-1319361619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-956b86c3-c711-4765-8e15-dcb67313a3e5" returned: 0 in 0.311s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6655e2e0-ddde-49eb-9287-b10cb372f3c2 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "cinder-quobyte-956b86c3-c711-4765-8e15-dcb67313a3e5" released by "delete_volume" :: held 0.865s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:33 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-6655e2e0-ddde-49eb-9287-b10cb372f3c2 tempest-CreateVolumesFromImageTest-1319361619 None] Created reservations ['66d262c2-b832-4e5d-b274-4a1b03ad426c', '8279412c-6a6d-4e41-9ce6-dcec787f20dc', '4fba580b-59cf-4a54-a0f6-ada05db2aa98', '9a6db74d-827f-436f-aed5-ef50783d600c'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6655e2e0-ddde-49eb-9287-b10cb372f3c2 tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6655e2e0-ddde-49eb-9287-b10cb372f3c2 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6655e2e0-ddde-49eb-9287-b10cb372f3c2 tempest-CreateVolumesFromImageTest-1319361619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6655e2e0-ddde-49eb-9287-b10cb372f3c2 tempest-CreateVolumesFromImageTest-1319361619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6655e2e0-ddde-49eb-9287-b10cb372f3c2 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6655e2e0-ddde-49eb-9287-b10cb372f3c2 tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:33 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:03:33 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e0ca3d5e-e23c-4bd6-857b-d8e594d124d2 tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "cinder-231f6e48-ab4c-4975-81af-b8df291ec473-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e0ca3d5e-e23c-4bd6-857b-d8e594d124d2 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "cinder-231f6e48-ab4c-4975-81af-b8df291ec473-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:34 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-613d32bd-640b-4091-a926-b6ec0ec429cb tempest-VolumesTransfersV357Test-971958946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4" returned: 0 in 0.459s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-613d32bd-640b-4091-a926-b6ec0ec429cb tempest-VolumesTransfersV357Test-971958946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:34 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4 Jul 14 13:03:34 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e0ca3d5e-e23c-4bd6-857b-d8e594d124d2 tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "cinder-quobyte-231f6e48-ab4c-4975-81af-b8df291ec473" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e0ca3d5e-e23c-4bd6-857b-d8e594d124d2 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "cinder-quobyte-231f6e48-ab4c-4975-81af-b8df291ec473" acquired by "delete_volume" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:34 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[beacb719-3a5c-4944-a7a7-e6627f290b11]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e0ca3d5e-e23c-4bd6-857b-d8e594d124d2 tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-231f6e48-ab4c-4975-81af-b8df291ec473 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:34 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6655e2e0-ddde-49eb-9287-b10cb372f3c2 tempest-CreateVolumesFromImageTest-1319361619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.381s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:34 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-6655e2e0-ddde-49eb-9287-b10cb372f3c2 tempest-CreateVolumesFromImageTest-1319361619 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:03:34 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-6655e2e0-ddde-49eb-9287-b10cb372f3c2 tempest-CreateVolumesFromImageTest-1319361619 None] Deleted volume successfully. Jul 14 13:03:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6655e2e0-ddde-49eb-9287-b10cb372f3c2 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "cinder-956b86c3-c711-4765-8e15-dcb67313a3e5-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:34 devstack sudo[96854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-231f6e48-ab4c-4975-81af-b8df291ec473 Jul 14 13:03:34 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:34 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-613d32bd-640b-4091-a926-b6ec0ec429cb tempest-VolumesTransfersV357Test-971958946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4" returned: 0 in 0.393s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-613d32bd-640b-4091-a926-b6ec0ec429cb tempest-VolumesTransfersV357Test-971958946 None] Lock "cinder-quobyte-ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4" released by "delete_volume" :: held 0.901s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:34 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-613d32bd-640b-4091-a926-b6ec0ec429cb tempest-VolumesTransfersV357Test-971958946 None] Created reservations ['0a1aad54-c17d-4159-879f-ba943e8cd1a0', 'bd431953-9330-4e60-bb85-afed0f887ad8', '9770ec78-a3a1-401c-b5fb-41f89f2ba163', '59b5db2d-03a1-407e-bc95-4a831409cb0b'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-613d32bd-640b-4091-a926-b6ec0ec429cb tempest-VolumesTransfersV357Test-971958946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-613d32bd-640b-4091-a926-b6ec0ec429cb tempest-VolumesTransfersV357Test-971958946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-613d32bd-640b-4091-a926-b6ec0ec429cb tempest-VolumesTransfersV357Test-971958946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-613d32bd-640b-4091-a926-b6ec0ec429cb tempest-VolumesTransfersV357Test-971958946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-613d32bd-640b-4091-a926-b6ec0ec429cb tempest-VolumesTransfersV357Test-971958946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-613d32bd-640b-4091-a926-b6ec0ec429cb tempest-VolumesTransfersV357Test-971958946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:34 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:03:34 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:34 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e0ca3d5e-e23c-4bd6-857b-d8e594d124d2 tempest-CreateVolumesFromImageTest-1319361619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-231f6e48-ab4c-4975-81af-b8df291ec473" returned: 0 in 0.554s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e0ca3d5e-e23c-4bd6-857b-d8e594d124d2 tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-231f6e48-ab4c-4975-81af-b8df291ec473 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:34 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-231f6e48-ab4c-4975-81af-b8df291ec473 Jul 14 13:03:34 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Flow 'volume_create_manager' (bca7e8b1-7d0d-49f8-85dc-68dad5b063a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e189fac-efc3-4f4c-8203-568df371dc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:35 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e0ca3d5e-e23c-4bd6-857b-d8e594d124d2 tempest-CreateVolumesFromImageTest-1319361619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-231f6e48-ab4c-4975-81af-b8df291ec473" returned: 0 in 0.330s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:35 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-613d32bd-640b-4091-a926-b6ec0ec429cb tempest-VolumesTransfersV357Test-971958946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.431s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e189fac-efc3-4f4c-8203-568df371dc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1412863177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f445d06-4f4f-4380-98f7-91e885b4eaf8,host='devstack@QuobyteHD#QuobyteHD',id=266ae7dd-5588-483b-823e-b3ada3755362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0dd6f29111e41e896a8cbeddd49d849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:35Z,use_quota=True,user_id='703a4aa40d42476d91fe7ce51fc54fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16859774-507b-47ab-aaf8-77250b7f6d48),volume_type_id=16859774-507b-47ab-aaf8-77250b7f6d48)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb7b337-1bf8-42fb-a0a9-eb50973bb455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb7b337-1bf8-42fb-a0a9-eb50973bb455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6917f43e-e639-49b7-be9c-e1d467d2dcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6917f43e-e639-49b7-be9c-e1d467d2dcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '266ae7dd-5588-483b-823e-b3ada3755362', 'volume_name': 'volume-266ae7dd-5588-483b-823e-b3ada3755362', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4343e76b-dfc4-4e74-865a-3e138e33980d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4343e76b-dfc4-4e74-865a-3e138e33980d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f3ac8b-3780-48be-a810-214d0d77e769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:35 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Volume 266ae7dd-5588-483b-823e-b3ada3755362: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-266ae7dd-5588-483b-823e-b3ada3755362', 'volume_size': 1} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4f445d06-4f4f-4380-98f7-91e885b4eaf8,created_at=2026-07-14T11:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1412863177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f445d06-4f4f-4380-98f7-91e885b4eaf8,host='devstack@QuobyteHD#QuobyteHD',id=266ae7dd-5588-483b-823e-b3ada3755362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0dd6f29111e41e896a8cbeddd49d849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:35Z,use_quota=True,user_id='703a4aa40d42476d91fe7ce51fc54fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16859774-507b-47ab-aaf8-77250b7f6d48),volume_type_id=16859774-507b-47ab-aaf8-77250b7f6d48)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Creating volume 266ae7dd-5588-483b-823e-b3ada3755362 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:03:35 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-613d32bd-640b-4091-a926-b6ec0ec429cb tempest-VolumesTransfersV357Test-971958946 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e0ca3d5e-e23c-4bd6-857b-d8e594d124d2 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "cinder-quobyte-231f6e48-ab4c-4975-81af-b8df291ec473" released by "delete_volume" :: held 1.036s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:35 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-613d32bd-640b-4091-a926-b6ec0ec429cb tempest-VolumesTransfersV357Test-971958946 None] Deleted volume successfully. Jul 14 13:03:35 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362 1073741824 Jul 14 13:03:35 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-613d32bd-640b-4091-a926-b6ec0ec429cb tempest-VolumesTransfersV357Test-971958946 None] Lock "cinder-ff3b64d1-9995-4c28-9ea6-fe5c9135e1b4-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-e0ca3d5e-e23c-4bd6-857b-d8e594d124d2 tempest-CreateVolumesFromImageTest-1319361619 None] Created reservations ['b87209b3-5f92-448b-ba60-08542040bbd8', '66e3c87f-c95f-4700-93c4-0123e2b524b5', 'e4b8d95e-a33a-4059-888d-30ce04a923b8', 'b37c6841-0b4b-47ad-8105-492271244109'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e0ca3d5e-e23c-4bd6-857b-d8e594d124d2 tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e0ca3d5e-e23c-4bd6-857b-d8e594d124d2 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e0ca3d5e-e23c-4bd6-857b-d8e594d124d2 tempest-CreateVolumesFromImageTest-1319361619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e0ca3d5e-e23c-4bd6-857b-d8e594d124d2 tempest-CreateVolumesFromImageTest-1319361619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e0ca3d5e-e23c-4bd6-857b-d8e594d124d2 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e0ca3d5e-e23c-4bd6-857b-d8e594d124d2 tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:35 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:03:35 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:35 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e0ca3d5e-e23c-4bd6-857b-d8e594d124d2 tempest-CreateVolumesFromImageTest-1319361619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.313s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-e0ca3d5e-e23c-4bd6-857b-d8e594d124d2 tempest-CreateVolumesFromImageTest-1319361619 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:03:35 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e0ca3d5e-e23c-4bd6-857b-d8e594d124d2 tempest-CreateVolumesFromImageTest-1319361619 None] Deleted volume successfully. Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e0ca3d5e-e23c-4bd6-857b-d8e594d124d2 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "cinder-231f6e48-ab4c-4975-81af-b8df291ec473-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:35 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362 1073741824" returned: 0 in 0.573s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:35 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362 Jul 14 13:03:35 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:36 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362" returned: 0 in 0.300s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:03:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f3ac8b-3780-48be-a810-214d0d77e769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-266ae7dd-5588-483b-823e-b3ada3755362', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5832c9da-9f90-414a-9eb9-c526a37986a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:36 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Volume volume-266ae7dd-5588-483b-823e-b3ada3755362 (266ae7dd-5588-483b-823e-b3ada3755362): created successfully Jul 14 13:03:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5832c9da-9f90-414a-9eb9-c526a37986a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Flow 'volume_create_manager' (bca7e8b1-7d0d-49f8-85dc-68dad5b063a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:36 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-78e313c9-7da7-42b4-a0af-3d8927794a3b tempest-GroupsV314Test-393283468 None] Created volume successfully. Jul 14 13:03:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5e7c6255-ba71-45aa-a1bf-498d5647a7ff tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "cinder-157cae33-5977-42cb-971a-93c3ad8ad1b5-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5e7c6255-ba71-45aa-a1bf-498d5647a7ff tempest-CreateVolumesFromImageTest-1319361619 None] Lock "cinder-157cae33-5977-42cb-971a-93c3ad8ad1b5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5e7c6255-ba71-45aa-a1bf-498d5647a7ff tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "cinder-quobyte-157cae33-5977-42cb-971a-93c3ad8ad1b5" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5e7c6255-ba71-45aa-a1bf-498d5647a7ff tempest-CreateVolumesFromImageTest-1319361619 None] Lock "cinder-quobyte-157cae33-5977-42cb-971a-93c3ad8ad1b5" acquired by "delete_volume" :: waited 0.020s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:36 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fdd310-748f-4c28-bac6-b2ffec1df925]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5e7c6255-ba71-45aa-a1bf-498d5647a7ff tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-157cae33-5977-42cb-971a-93c3ad8ad1b5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:36 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-157cae33-5977-42cb-971a-93c3ad8ad1b5 Jul 14 13:03:36 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:36 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5e7c6255-ba71-45aa-a1bf-498d5647a7ff tempest-CreateVolumesFromImageTest-1319361619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-157cae33-5977-42cb-971a-93c3ad8ad1b5" returned: 0 in 0.418s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5e7c6255-ba71-45aa-a1bf-498d5647a7ff tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-157cae33-5977-42cb-971a-93c3ad8ad1b5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:36 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-157cae33-5977-42cb-971a-93c3ad8ad1b5 Jul 14 13:03:36 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:37 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5e7c6255-ba71-45aa-a1bf-498d5647a7ff tempest-CreateVolumesFromImageTest-1319361619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-157cae33-5977-42cb-971a-93c3ad8ad1b5" returned: 0 in 0.289s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5e7c6255-ba71-45aa-a1bf-498d5647a7ff tempest-CreateVolumesFromImageTest-1319361619 None] Lock "cinder-quobyte-157cae33-5977-42cb-971a-93c3ad8ad1b5" released by "delete_volume" :: held 0.773s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:37 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-5e7c6255-ba71-45aa-a1bf-498d5647a7ff tempest-CreateVolumesFromImageTest-1319361619 None] Created reservations ['9d0d79f8-5a91-4d27-90ff-548c459b4e85', '6090010e-8711-491e-a4eb-83cca9017676', '15be9040-ea42-4940-9002-7ae69bc406f0', '70c306bd-967b-455e-baf6-8d8ae4de674f'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5e7c6255-ba71-45aa-a1bf-498d5647a7ff tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5e7c6255-ba71-45aa-a1bf-498d5647a7ff tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c6255-ba71-45aa-a1bf-498d5647a7ff tempest-CreateVolumesFromImageTest-1319361619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c6255-ba71-45aa-a1bf-498d5647a7ff tempest-CreateVolumesFromImageTest-1319361619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5e7c6255-ba71-45aa-a1bf-498d5647a7ff tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5e7c6255-ba71-45aa-a1bf-498d5647a7ff tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:37 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:03:37 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:37 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-38577bbc-d346-4a8f-880d-8cbfd44cec1f tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "cinder-dd223ad1-0157-4c24-8ee7-270ebfe3db3b-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5e7c6255-ba71-45aa-a1bf-498d5647a7ff tempest-CreateVolumesFromImageTest-1319361619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.385s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:37 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-5e7c6255-ba71-45aa-a1bf-498d5647a7ff tempest-CreateVolumesFromImageTest-1319361619 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:03:37 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-5e7c6255-ba71-45aa-a1bf-498d5647a7ff tempest-CreateVolumesFromImageTest-1319361619 None] Deleted volume successfully. Jul 14 13:03:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-38577bbc-d346-4a8f-880d-8cbfd44cec1f tempest-CreateVolumesFromImageTest-1319361619 None] Lock "cinder-dd223ad1-0157-4c24-8ee7-270ebfe3db3b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5e7c6255-ba71-45aa-a1bf-498d5647a7ff tempest-CreateVolumesFromImageTest-1319361619 None] Lock "cinder-157cae33-5977-42cb-971a-93c3ad8ad1b5-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-38577bbc-d346-4a8f-880d-8cbfd44cec1f tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "cinder-quobyte-dd223ad1-0157-4c24-8ee7-270ebfe3db3b" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-38577bbc-d346-4a8f-880d-8cbfd44cec1f tempest-CreateVolumesFromImageTest-1319361619 None] Lock "cinder-quobyte-dd223ad1-0157-4c24-8ee7-270ebfe3db3b" acquired by "delete_volume" :: waited 0.035s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:37 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[b180acdd-2cfc-4f47-86ca-2e83d15c9dcd]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38577bbc-d346-4a8f-880d-8cbfd44cec1f tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd223ad1-0157-4c24-8ee7-270ebfe3db3b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Flow 'volume_create_manager' (42e247f6-7889-472b-98b2-91f573add183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45631845-a50b-41c8-8dd5-c09ea5b84de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45631845-a50b-41c8-8dd5-c09ea5b84de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1538308185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfba27f5-a3da-4096-946b-f9ef2e6261e7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='600c7d69611b49fab458d16c46436dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:38Z,use_quota=True,user_id='4a7abaac76744f31969c3fb8c6679cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eff3073-9669-43a1-93a6-fe8e8ce788a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eff3073-9669-43a1-93a6-fe8e8ce788a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1002ca-ab53-474e-8d51-0b150cd6a18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1002ca-ab53-474e-8d51-0b150cd6a18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfba27f5-a3da-4096-946b-f9ef2e6261e7', 'volume_name': 'volume-cfba27f5-a3da-4096-946b-f9ef2e6261e7', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd38155d-0e9f-4888-a705-b868729ba645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd38155d-0e9f-4888-a705-b868729ba645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9a94ee-217f-432c-a225-f30ea2eda126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:38 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Volume cfba27f5-a3da-4096-946b-f9ef2e6261e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfba27f5-a3da-4096-946b-f9ef2e6261e7', 'volume_size': 1} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1538308185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfba27f5-a3da-4096-946b-f9ef2e6261e7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='600c7d69611b49fab458d16c46436dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:38Z,use_quota=True,user_id='4a7abaac76744f31969c3fb8c6679cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Creating volume cfba27f5-a3da-4096-946b-f9ef2e6261e7 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:03:38 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cfba27f5-a3da-4096-946b-f9ef2e6261e7 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:38 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd223ad1-0157-4c24-8ee7-270ebfe3db3b Jul 14 13:03:38 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:38 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cfba27f5-a3da-4096-946b-f9ef2e6261e7 1073741824 Jul 14 13:03:38 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:38 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38577bbc-d346-4a8f-880d-8cbfd44cec1f tempest-CreateVolumesFromImageTest-1319361619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd223ad1-0157-4c24-8ee7-270ebfe3db3b" returned: 0 in 0.468s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38577bbc-d346-4a8f-880d-8cbfd44cec1f tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd223ad1-0157-4c24-8ee7-270ebfe3db3b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:38 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd223ad1-0157-4c24-8ee7-270ebfe3db3b Jul 14 13:03:38 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:38 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38577bbc-d346-4a8f-880d-8cbfd44cec1f tempest-CreateVolumesFromImageTest-1319361619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dd223ad1-0157-4c24-8ee7-270ebfe3db3b" returned: 0 in 0.349s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-38577bbc-d346-4a8f-880d-8cbfd44cec1f tempest-CreateVolumesFromImageTest-1319361619 None] Lock "cinder-quobyte-dd223ad1-0157-4c24-8ee7-270ebfe3db3b" released by "delete_volume" :: held 0.888s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:38 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cfba27f5-a3da-4096-946b-f9ef2e6261e7 1073741824" returned: 0 in 0.762s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-38577bbc-d346-4a8f-880d-8cbfd44cec1f tempest-CreateVolumesFromImageTest-1319361619 None] Created reservations ['898e0335-4a0e-438c-967c-a0aac40f767b', '9950217b-3da3-4a11-a0ec-8451b3c15531', 'cc8054cc-1516-4032-8cee-10d618734430', '183320f8-f8fc-45a3-995c-0d90ee21cc0f'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cfba27f5-a3da-4096-946b-f9ef2e6261e7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:38 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cfba27f5-a3da-4096-946b-f9ef2e6261e7 Jul 14 13:03:38 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-38577bbc-d346-4a8f-880d-8cbfd44cec1f tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-38577bbc-d346-4a8f-880d-8cbfd44cec1f tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:39 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-38577bbc-d346-4a8f-880d-8cbfd44cec1f tempest-CreateVolumesFromImageTest-1319361619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:39 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-38577bbc-d346-4a8f-880d-8cbfd44cec1f tempest-CreateVolumesFromImageTest-1319361619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-38577bbc-d346-4a8f-880d-8cbfd44cec1f tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38577bbc-d346-4a8f-880d-8cbfd44cec1f tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:39 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:03:39 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:39 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cfba27f5-a3da-4096-946b-f9ef2e6261e7" returned: 0 in 0.288s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:39 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:03:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.813s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:39 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Cloning volume 266ae7dd-5588-483b-823e-b3ada3755362 to volume a5ec6d6e-ad59-466a-8185-f38975ab342b Jul 14 13:03:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9a94ee-217f-432c-a225-f30ea2eda126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfba27f5-a3da-4096-946b-f9ef2e6261e7', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4745667d-3387-4b81-a218-5473add26732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:39 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Volume volume-cfba27f5-a3da-4096-946b-f9ef2e6261e7 (cfba27f5-a3da-4096-946b-f9ef2e6261e7): created successfully Jul 14 13:03:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4745667d-3387-4b81-a218-5473add26732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Flow 'volume_create_manager' (42e247f6-7889-472b-98b2-91f573add183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:39 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-38577bbc-d346-4a8f-880d-8cbfd44cec1f tempest-CreateVolumesFromImageTest-1319361619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.293s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:39 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-38577bbc-d346-4a8f-880d-8cbfd44cec1f tempest-CreateVolumesFromImageTest-1319361619 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:03:39 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-242773db-32cf-48bd-a79d-8cc452dd4000 tempest-VolumesTestJSON-1819272233 None] Created volume successfully. Jul 14 13:03:39 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Creating offline snapshot 9a0771e4-41a3-435c-a001-53ea26eaea96 of volume 266ae7dd-5588-483b-823e-b3ada3755362 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:03:39 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-38577bbc-d346-4a8f-880d-8cbfd44cec1f tempest-CreateVolumesFromImageTest-1319361619 None] Deleted volume successfully. Jul 14 13:03:39 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8cd81c-8e2c-4c73-a791-ab0b736cbdfe]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-38577bbc-d346-4a8f-880d-8cbfd44cec1f tempest-CreateVolumesFromImageTest-1319361619 None] Lock "cinder-dd223ad1-0157-4c24-8ee7-270ebfe3db3b-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:39 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362 Jul 14 13:03:39 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:39 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362" returned: 0 in 0.365s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:39 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96 1G Jul 14 13:03:39 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c5073ada-b562-4774-95dd-915933ccedc1 tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "cinder-a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c5073ada-b562-4774-95dd-915933ccedc1 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "cinder-a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c5073ada-b562-4774-95dd-915933ccedc1 tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "cinder-quobyte-a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c5073ada-b562-4774-95dd-915933ccedc1 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "cinder-quobyte-a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7" acquired by "delete_volume" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:40 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96 1G" returned: 0 in 0.583s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-266ae7dd-5588-483b-823e-b3ada3755362 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[d524bafe-71a6-4f37-a2e9-8eaa57035f20]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5073ada-b562-4774-95dd-915933ccedc1 tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:40 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-266ae7dd-5588-483b-823e-b3ada3755362 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96 Jul 14 13:03:40 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:40 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7 Jul 14 13:03:40 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:03:40 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Flow 'volume_create_manager' (cbef05df-1cc8-479d-9729-91e827552086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f72f95-2227-4cc8-ab88-a182ecf6220c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-266ae7dd-5588-483b-823e-b3ada3755362 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96" returned: 0 in 0.450s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:40 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96 is being set with open permissions: ugo+rw: NotImplementedError Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:40 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f72f95-2227-4cc8-ab88-a182ecf6220c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-509475843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e122b8-ea51-4f43-bb69-d38e7bf5c0fe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='600c7d69611b49fab458d16c46436dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:41Z,use_quota=True,user_id='4a7abaac76744f31969c3fb8c6679cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:40 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96 Jul 14 13:03:40 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (930ca48c-bc32-45fc-a459-a12814487569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (930ca48c-bc32-45fc-a459-a12814487569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6736ba3b-8866-49df-99c3-28963a5046b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6736ba3b-8866-49df-99c3-28963a5046b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41e122b8-ea51-4f43-bb69-d38e7bf5c0fe', 'volume_name': 'volume-41e122b8-ea51-4f43-bb69-d38e7bf5c0fe', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9fa65b-7d74-43c4-abc0-821e5e350944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9fa65b-7d74-43c4-abc0-821e5e350944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0a6ad0-88f1-4ee4-b332-4d26c327e0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:40 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Volume 41e122b8-ea51-4f43-bb69-d38e7bf5c0fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41e122b8-ea51-4f43-bb69-d38e7bf5c0fe', 'volume_size': 1} Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5073ada-b562-4774-95dd-915933ccedc1 tempest-CreateVolumesFromImageTest-1319361619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7" returned: 0 in 0.505s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5073ada-b562-4774-95dd-915933ccedc1 tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:40 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7 Jul 14 13:03:40 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:41 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96" returned: 0 in 0.280s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:41 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5073ada-b562-4774-95dd-915933ccedc1 tempest-CreateVolumesFromImageTest-1319361619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7" returned: 0 in 0.277s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:41 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.info Jul 14 13:03:41 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c5073ada-b562-4774-95dd-915933ccedc1 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "cinder-quobyte-a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7" released by "delete_volume" :: held 0.842s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-c5073ada-b562-4774-95dd-915933ccedc1 tempest-CreateVolumesFromImageTest-1319361619 None] Created reservations ['604bfb0f-dfcf-4be4-b21c-95c227a0aee9', '0f6fd23e-dd6a-4735-8272-8ca66eba2f62', '7c15f7ef-94ef-4b06-bab0-670fbf7ac3fe', '67363902-de1c-4dfb-af4c-a7cd657a8b8e'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c5073ada-b562-4774-95dd-915933ccedc1 tempest-CreateVolumesFromImageTest-1319361619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c5073ada-b562-4774-95dd-915933ccedc1 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c5073ada-b562-4774-95dd-915933ccedc1 tempest-CreateVolumesFromImageTest-1319361619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c5073ada-b562-4774-95dd-915933ccedc1 tempest-CreateVolumesFromImageTest-1319361619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c5073ada-b562-4774-95dd-915933ccedc1 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5073ada-b562-4774-95dd-915933ccedc1 tempest-CreateVolumesFromImageTest-1319361619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:41 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:03:41 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:41 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.info" returned: 0 in 0.404s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:41 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.info is being set with open permissions: ugo+rw: NotImplementedError Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:41 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.info Jul 14 13:03:41 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:41 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5073ada-b562-4774-95dd-915933ccedc1 tempest-CreateVolumesFromImageTest-1319361619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.266s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-c5073ada-b562-4774-95dd-915933ccedc1 tempest-CreateVolumesFromImageTest-1319361619 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:03:41 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c5073ada-b562-4774-95dd-915933ccedc1 tempest-CreateVolumesFromImageTest-1319361619 None] Deleted volume successfully. Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c5073ada-b562-4774-95dd-915933ccedc1 tempest-CreateVolumesFromImageTest-1319361619 None] Lock "cinder-a93ba3b3-9bd2-4a6c-b51a-f42841a6ebd7-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:41 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.info" returned: 0 in 0.299s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Acquiring lock "cinder-quobyte-a5ec6d6e-ad59-466a-8185-f38975ab342b" by "_copy_volume_from_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Lock "cinder-quobyte-a5ec6d6e-ad59-466a-8185-f38975ab342b" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] snapshot: 9a0771e4-41a3-435c-a001-53ea26eaea96, volume: a5ec6d6e-ad59-466a-8185-f38975ab342b, {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c06681-4ab5-4ccd-ae87-e44f181677c6]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:41 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96 Jul 14 13:03:41 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:41 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:03:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Flow 'volume_create_manager' (813520f7-d212-47ab-a525-030ad21eade1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f0b070e-ef25-424d-85a4-5ecee9c53ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f0b070e-ef25-424d-85a4-5ecee9c53ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-71019983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7351525e771449c592e2b68b78b6b101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:42Z,use_quota=True,user_id='699562c26b874be9b7ce45a20d384408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c98b13-ff3e-4e7c-b71e-56d9ac31989e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c98b13-ff3e-4e7c-b71e-56d9ac31989e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d487ed5-b4a9-4494-a79c-e76632b3b2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d487ed5-b4a9-4494-a79c-e76632b3b2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b', 'volume_name': 'volume-00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98dd32a4-f422-4e24-bc92-c62c93516ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98dd32a4-f422-4e24-bc92-c62c93516ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62525dda-191e-4ed8-b9cb-7a542ccb8f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:42 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Volume 00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b', 'volume_size': 1} Jul 14 13:03:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:42 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96" returned: 0 in 0.359s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:42 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-266ae7dd-5588-483b-823e-b3ada3755362(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:03:42 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362 {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 13:03:42 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Creating direct copy from snapshot {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 13:03:42 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a467af0-c82a-4e02-8069-2aa752b0b12e]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:42 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362 Jul 14 13:03:42 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:42 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362" returned: 0 in 0.379s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:42 devstack cinder-volume[86977]: DEBUG cinder.utils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Path /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a5ec6d6e-ad59-466a-8185-f38975ab342b not found in is_blk_device check {{(pid=86977) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 13:03:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a5ec6d6e-ad59-466a-8185-f38975ab342b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:42 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a5ec6d6e-ad59-466a-8185-f38975ab342b Jul 14 13:03:42 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:47 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a5ec6d6e-ad59-466a-8185-f38975ab342b" returned: 0 in 4.879s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:47 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[45585d69-c005-40ea-8c41-ac62d4fe777e]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:47 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362 Jul 14 13:03:47 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:47 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:03:47 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Flow 'volume_create_manager' (d83a6faa-19ef-4aa4-ae65-e5589f558712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:47 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539e5faf-33b7-4639-884c-5e564e712e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:47 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539e5faf-33b7-4639-884c-5e564e712e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1543063336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e0d7e8-dc73-4a16-b873-0ddf7bc92211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b08131aed44d59866c04dc8bb1090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:48Z,use_quota=True,user_id='9bae8baabd6548ae87a78590fee7ba8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:47 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0cc9a42-5295-4f45-9973-9ae4c05ea554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:47 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0cc9a42-5295-4f45-9973-9ae4c05ea554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:47 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a6729f-365c-4556-b3b9-3cf26b5ebf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:47 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a6729f-365c-4556-b3b9-3cf26b5ebf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e0d7e8-dc73-4a16-b873-0ddf7bc92211', 'volume_name': 'volume-b9e0d7e8-dc73-4a16-b873-0ddf7bc92211', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:47 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8aab93-a69f-4123-84ae-fa7e3941df6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:47 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8aab93-a69f-4123-84ae-fa7e3941df6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:47 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f089b8e2-af91-4696-b08d-abf2f0c5c4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:47 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Volume b9e0d7e8-dc73-4a16-b873-0ddf7bc92211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e0d7e8-dc73-4a16-b873-0ddf7bc92211', 'volume_size': 1} Jul 14 13:03:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:48 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362" returned: 0 in 0.533s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:48 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Image conversion details: src /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362, size 1024.00 MB, duration 4.88 sec, destination /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a5ec6d6e-ad59-466a-8185-f38975ab342b {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:03:48 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Converted 1024.00 MB image at 209.81 MB/s Jul 14 13:03:48 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a5ec6d6e-ad59-466a-8185-f38975ab342b is being set with open permissions: ugo+rw: NotImplementedError Jul 14 13:03:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a5ec6d6e-ad59-466a-8185-f38975ab342b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:48 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a5ec6d6e-ad59-466a-8185-f38975ab342b Jul 14 13:03:48 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:48 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a5ec6d6e-ad59-466a-8185-f38975ab342b" returned: 0 in 0.242s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:48 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Lock "cinder-quobyte-a5ec6d6e-ad59-466a-8185-f38975ab342b" released by "_copy_volume_from_snapshot" :: held 6.477s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:48 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Acquiring lock "cinder-quobyte-9a0771e4-41a3-435c-a001-53ea26eaea96" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:48 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Lock "cinder-quobyte-9a0771e4-41a3-435c-a001-53ea26eaea96" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:48 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Deleting offline snapshot 9a0771e4-41a3-435c-a001-53ea26eaea96 of volume 266ae7dd-5588-483b-823e-b3ada3755362 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:03:48 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] snapshot_file for this snap is: volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:03:48 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[626b4d96-dd6e-4341-b19c-0327ec7c8f2b]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:48 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96 Jul 14 13:03:48 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:48 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96" returned: 0 in 0.349s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:48 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-266ae7dd-5588-483b-823e-b3ada3755362(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:03:48 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[af63722f-038d-4704-a050-1e55e5badc12]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:48 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362 Jul 14 13:03:48 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:49 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362" returned: 0 in 0.345s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:49 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96 Jul 14 13:03:49 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:49 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96" returned: 0 in 0.334s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:49 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96 Jul 14 13:03:49 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:49 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362.9a0771e4-41a3-435c-a001-53ea26eaea96" returned: 0 in 0.240s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:49 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Lock "cinder-quobyte-9a0771e4-41a3-435c-a001-53ea26eaea96" released by "_delete_snapshot" :: held 1.356s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.468s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.884s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:49 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-509475843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e122b8-ea51-4f43-bb69-d38e7bf5c0fe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='600c7d69611b49fab458d16c46436dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:41Z,use_quota=True,user_id='4a7abaac76744f31969c3fb8c6679cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:03:49 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Creating volume 41e122b8-ea51-4f43-bb69-d38e7bf5c0fe {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:03:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:49 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:49 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:49 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:03:49 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:03:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-41e122b8-ea51-4f43-bb69-d38e7bf5c0fe 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:49 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-41e122b8-ea51-4f43-bb69-d38e7bf5c0fe 1073741824 Jul 14 13:03:49 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:49 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-a81f19c2-b227-4c94-baba-f87b3c1c4519 tempest-GroupsV314Test-393283468 None] Create group from source-group-4f445d06-4f4f-4380-98f7-91e885b4eaf8 completed successfully. Jul 14 13:03:50 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-41e122b8-ea51-4f43-bb69-d38e7bf5c0fe 1073741824" returned: 0 in 0.429s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-41e122b8-ea51-4f43-bb69-d38e7bf5c0fe {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:50 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-41e122b8-ea51-4f43-bb69-d38e7bf5c0fe Jul 14 13:03:50 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:50 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-41e122b8-ea51-4f43-bb69-d38e7bf5c0fe" returned: 0 in 0.253s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.360s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-71019983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7351525e771449c592e2b68b78b6b101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:42Z,use_quota=True,user_id='699562c26b874be9b7ce45a20d384408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Creating volume 00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:03:50 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0a6ad0-88f1-4ee4-b332-4d26c327e0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41e122b8-ea51-4f43-bb69-d38e7bf5c0fe', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b4debd-85c3-4541-a80a-c2e4c8ee2109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:50 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b 1073741824 Jul 14 13:03:50 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c4713a2b-54f7-41a7-83da-e501949b9f79 tempest-GroupsV314Test-393283468 None] Acquiring lock "cinder-quobyte-a5ec6d6e-ad59-466a-8185-f38975ab342b" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:50 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Volume volume-41e122b8-ea51-4f43-bb69-d38e7bf5c0fe (41e122b8-ea51-4f43-bb69-d38e7bf5c0fe): created successfully Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b4debd-85c3-4541-a80a-c2e4c8ee2109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Flow 'volume_create_manager' (cbef05df-1cc8-479d-9729-91e827552086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c4713a2b-54f7-41a7-83da-e501949b9f79 tempest-GroupsV314Test-393283468 None] Lock "cinder-quobyte-a5ec6d6e-ad59-466a-8185-f38975ab342b" acquired by "delete_volume" :: waited 0.035s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:50 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-33c36c14-46d1-42a8-a1f6-d186264f1b03 tempest-VolumesTestJSON-1819272233 None] Created volume successfully. Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[79db9f84-5eef-4796-9970-ba1b55edcdc4]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c4713a2b-54f7-41a7-83da-e501949b9f79 tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a5ec6d6e-ad59-466a-8185-f38975ab342b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:50 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a5ec6d6e-ad59-466a-8185-f38975ab342b Jul 14 13:03:50 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:50 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b 1073741824" returned: 0 in 0.440s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:50 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b Jul 14 13:03:50 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:50 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c4713a2b-54f7-41a7-83da-e501949b9f79 tempest-GroupsV314Test-393283468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a5ec6d6e-ad59-466a-8185-f38975ab342b" returned: 0 in 0.391s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c4713a2b-54f7-41a7-83da-e501949b9f79 tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a5ec6d6e-ad59-466a-8185-f38975ab342b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:50 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a5ec6d6e-ad59-466a-8185-f38975ab342b Jul 14 13:03:50 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:51 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b" returned: 0 in 0.237s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.169s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1543063336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e0d7e8-dc73-4a16-b873-0ddf7bc92211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b08131aed44d59866c04dc8bb1090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:48Z,use_quota=True,user_id='9bae8baabd6548ae87a78590fee7ba8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Creating volume b9e0d7e8-dc73-4a16-b873-0ddf7bc92211 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:03:51 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9e0d7e8-dc73-4a16-b873-0ddf7bc92211 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62525dda-191e-4ed8-b9cb-7a542ccb8f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:51 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:51 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9e0d7e8-dc73-4a16-b873-0ddf7bc92211 1073741824 Jul 14 13:03:51 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8d92148-f590-4292-9a0f-bacebb03a0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c4713a2b-54f7-41a7-83da-e501949b9f79 tempest-GroupsV314Test-393283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a5ec6d6e-ad59-466a-8185-f38975ab342b" returned: 0 in 0.260s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c4713a2b-54f7-41a7-83da-e501949b9f79 tempest-GroupsV314Test-393283468 None] Lock "cinder-quobyte-a5ec6d6e-ad59-466a-8185-f38975ab342b" released by "delete_volume" :: held 0.709s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:51 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Volume volume-00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b (00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b): created successfully Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8d92148-f590-4292-9a0f-bacebb03a0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Flow 'volume_create_manager' (813520f7-d212-47ab-a525-030ad21eade1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:51 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-0449b759-2cda-4925-9494-0d63b6279afa tempest-VolumesGetTest-1140409626 None] Created volume successfully. Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-c4713a2b-54f7-41a7-83da-e501949b9f79 tempest-GroupsV314Test-393283468 None] Created reservations ['42b46c59-7a7e-4388-97b9-baae96ee73d7'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:51 devstack cinder-volume[86977]: WARNING cinder.quota [None req-c4713a2b-54f7-41a7-83da-e501949b9f79 tempest-GroupsV314Test-393283468 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2112782371 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2112782371, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:03:51 devstack cinder-volume[86977]: WARNING cinder.quota [None req-c4713a2b-54f7-41a7-83da-e501949b9f79 tempest-GroupsV314Test-393283468 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2112782371 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2112782371, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-c4713a2b-54f7-41a7-83da-e501949b9f79 tempest-GroupsV314Test-393283468 None] Created reservations ['a7b1abcc-1eb2-4899-a35f-cc0b0b966768', 'ef5f094c-bdf4-4923-8176-e0ce5f952616', '98c3ae6f-7e7e-4aac-9339-31061c910a53', '33c7f5fc-1939-4fa8-b64e-7c43d6c23120'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c4713a2b-54f7-41a7-83da-e501949b9f79 tempest-GroupsV314Test-393283468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c4713a2b-54f7-41a7-83da-e501949b9f79 tempest-GroupsV314Test-393283468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c4713a2b-54f7-41a7-83da-e501949b9f79 tempest-GroupsV314Test-393283468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c4713a2b-54f7-41a7-83da-e501949b9f79 tempest-GroupsV314Test-393283468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c4713a2b-54f7-41a7-83da-e501949b9f79 tempest-GroupsV314Test-393283468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c4713a2b-54f7-41a7-83da-e501949b9f79 tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:51 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:03:51 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:51 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9e0d7e8-dc73-4a16-b873-0ddf7bc92211 1073741824" returned: 0 in 0.530s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9e0d7e8-dc73-4a16-b873-0ddf7bc92211 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:51 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c4713a2b-54f7-41a7-83da-e501949b9f79 tempest-GroupsV314Test-393283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.293s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-c4713a2b-54f7-41a7-83da-e501949b9f79 tempest-GroupsV314Test-393283468 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:03:51 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c4713a2b-54f7-41a7-83da-e501949b9f79 tempest-GroupsV314Test-393283468 None] Delete group completed successfully. Jul 14 13:03:51 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9e0d7e8-dc73-4a16-b873-0ddf7bc92211 Jul 14 13:03:51 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bdae4854-1358-46ff-93a1-35ec63138c55 tempest-GroupsV314Test-393283468 None] Acquiring lock "cinder-quobyte-266ae7dd-5588-483b-823e-b3ada3755362" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bdae4854-1358-46ff-93a1-35ec63138c55 tempest-GroupsV314Test-393283468 None] Lock "cinder-quobyte-266ae7dd-5588-483b-823e-b3ada3755362" acquired by "delete_volume" :: waited 0.030s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[2545db89-2dac-49d0-a014-9f2e192b68f8]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bdae4854-1358-46ff-93a1-35ec63138c55 tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:52 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9e0d7e8-dc73-4a16-b873-0ddf7bc92211" returned: 0 in 0.329s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f089b8e2-af91-4696-b08d-abf2f0c5c4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e0d7e8-dc73-4a16-b873-0ddf7bc92211', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6e601e-3208-456a-9278-954cd8464bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:52 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Volume volume-b9e0d7e8-dc73-4a16-b873-0ddf7bc92211 (b9e0d7e8-dc73-4a16-b873-0ddf7bc92211): created successfully Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6e601e-3208-456a-9278-954cd8464bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Flow 'volume_create_manager' (d83a6faa-19ef-4aa4-ae65-e5589f558712) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:52 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-7c1ead2b-1bdd-4b93-8afe-f6b22e67465b tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Created volume successfully. Jul 14 13:03:52 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362 Jul 14 13:03:52 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Flow 'volume_create_manager' (c6f22bec-2acd-45c8-a7b7-2bb8769b0740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84e7414-3b5e-43ea-bf63-7698d7d7e653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84e7414-3b5e-43ea-bf63-7698d7d7e653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1721299033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be5a828f-061a-4e29-999b-e0ab43607839,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='600c7d69611b49fab458d16c46436dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:52Z,use_quota=True,user_id='4a7abaac76744f31969c3fb8c6679cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3528e30-30c1-4bb4-8a09-80288d12e7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3528e30-30c1-4bb4-8a09-80288d12e7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c547a60-581e-4821-99a8-3deb86286114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c547a60-581e-4821-99a8-3deb86286114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be5a828f-061a-4e29-999b-e0ab43607839', 'volume_name': 'volume-be5a828f-061a-4e29-999b-e0ab43607839', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be1ae94-2881-49fc-b339-65ff818552d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be1ae94-2881-49fc-b339-65ff818552d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff38ea7-61f3-46c0-87dc-0b694f13b8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:52 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Volume be5a828f-061a-4e29-999b-e0ab43607839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be5a828f-061a-4e29-999b-e0ab43607839', 'volume_size': 1} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1721299033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be5a828f-061a-4e29-999b-e0ab43607839,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='600c7d69611b49fab458d16c46436dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:52Z,use_quota=True,user_id='4a7abaac76744f31969c3fb8c6679cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Creating volume be5a828f-061a-4e29-999b-e0ab43607839 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:03:52 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be5a828f-061a-4e29-999b-e0ab43607839 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:52 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be5a828f-061a-4e29-999b-e0ab43607839 1073741824 Jul 14 13:03:52 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:52 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bdae4854-1358-46ff-93a1-35ec63138c55 tempest-GroupsV314Test-393283468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362" returned: 0 in 0.462s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bdae4854-1358-46ff-93a1-35ec63138c55 tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:52 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362 Jul 14 13:03:52 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:52 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bdae4854-1358-46ff-93a1-35ec63138c55 tempest-GroupsV314Test-393283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266ae7dd-5588-483b-823e-b3ada3755362" returned: 0 in 0.305s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bdae4854-1358-46ff-93a1-35ec63138c55 tempest-GroupsV314Test-393283468 None] Lock "cinder-quobyte-266ae7dd-5588-483b-823e-b3ada3755362" released by "delete_volume" :: held 0.840s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Flow 'volume_create_manager' (c0cd726f-1afc-4582-ae39-0acb636ff4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:52 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46878b9-2a14-4574-9fa5-8d34a2974e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be5a828f-061a-4e29-999b-e0ab43607839 1073741824" returned: 0 in 0.495s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46878b9-2a14-4574-9fa5-8d34a2974e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1963905385',display_name='tempest-VolumesGetTest-Volume-2080142599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2e69be-c417-4a52-9143-9893fa326adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7351525e771449c592e2b68b78b6b101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:53Z,use_quota=True,user_id='699562c26b874be9b7ce45a20d384408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1d03ec-0c93-4b1b-87a3-d244eedc304b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1d03ec-0c93-4b1b-87a3-d244eedc304b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273746a0-f1e8-4a46-a945-252465d534d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273746a0-f1e8-4a46-a945-252465d534d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb2e69be-c417-4a52-9143-9893fa326adc', 'volume_name': 'volume-fb2e69be-c417-4a52-9143-9893fa326adc', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9728fd16-b0f3-4318-8d20-bf94d1b10f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9728fd16-b0f3-4318-8d20-bf94d1b10f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb8f14a-dfaf-48c2-b993-ea39888be098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:53 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Volume fb2e69be-c417-4a52-9143-9893fa326adc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb2e69be-c417-4a52-9143-9893fa326adc', 'volume_size': 1} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-bdae4854-1358-46ff-93a1-35ec63138c55 tempest-GroupsV314Test-393283468 None] Created reservations ['938ff50c-bbae-45bf-bd20-63194437651a'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be5a828f-061a-4e29-999b-e0ab43607839 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:53 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be5a828f-061a-4e29-999b-e0ab43607839 Jul 14 13:03:53 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-bdae4854-1358-46ff-93a1-35ec63138c55 tempest-GroupsV314Test-393283468 None] Created reservations ['b9daf600-ec13-41f6-8e95-cc2e1f662fdd', '1cbcc631-edf8-40b7-b3c7-4b591043f906', '895b3331-72e1-46cf-8cbd-1eef206c2459', '84eebc6e-5180-43ad-9f09-f198747e3524'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bdae4854-1358-46ff-93a1-35ec63138c55 tempest-GroupsV314Test-393283468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bdae4854-1358-46ff-93a1-35ec63138c55 tempest-GroupsV314Test-393283468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-bdae4854-1358-46ff-93a1-35ec63138c55 tempest-GroupsV314Test-393283468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-bdae4854-1358-46ff-93a1-35ec63138c55 tempest-GroupsV314Test-393283468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bdae4854-1358-46ff-93a1-35ec63138c55 tempest-GroupsV314Test-393283468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bdae4854-1358-46ff-93a1-35ec63138c55 tempest-GroupsV314Test-393283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:53 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:03:53 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:53 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be5a828f-061a-4e29-999b-e0ab43607839" returned: 0 in 0.304s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.346s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1963905385',display_name='tempest-VolumesGetTest-Volume-2080142599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2e69be-c417-4a52-9143-9893fa326adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7351525e771449c592e2b68b78b6b101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:53Z,use_quota=True,user_id='699562c26b874be9b7ce45a20d384408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Creating volume fb2e69be-c417-4a52-9143-9893fa326adc {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:03:53 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fb2e69be-c417-4a52-9143-9893fa326adc 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:53 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fb2e69be-c417-4a52-9143-9893fa326adc 1073741824 Jul 14 13:03:53 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff38ea7-61f3-46c0-87dc-0b694f13b8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be5a828f-061a-4e29-999b-e0ab43607839', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ac3d59-30eb-4214-b98c-d614cccfd5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:53 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Volume volume-be5a828f-061a-4e29-999b-e0ab43607839 (be5a828f-061a-4e29-999b-e0ab43607839): created successfully Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ac3d59-30eb-4214-b98c-d614cccfd5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Flow 'volume_create_manager' (c6f22bec-2acd-45c8-a7b7-2bb8769b0740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:53 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bdae4854-1358-46ff-93a1-35ec63138c55 tempest-GroupsV314Test-393283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.312s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-bdae4854-1358-46ff-93a1-35ec63138c55 tempest-GroupsV314Test-393283468 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:03:53 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e8fd5178-ba4a-44c5-8895-c1518ab9a450 tempest-VolumesTestJSON-1819272233 None] Created volume successfully. Jul 14 13:03:53 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-bdae4854-1358-46ff-93a1-35ec63138c55 tempest-GroupsV314Test-393283468 None] Delete group completed successfully. Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:03:53 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Flow 'volume_create_manager' (fe93c77c-05a4-49fd-9ca7-bb09d0402dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcb4100e-e2e7-4b26-9341-eb66967f9782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fb2e69be-c417-4a52-9143-9893fa326adc 1073741824" returned: 0 in 0.608s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcb4100e-e2e7-4b26-9341-eb66967f9782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-6534953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdb152ef-1e86-4025-bd08-5e9e4282ed8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b08131aed44d59866c04dc8bb1090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:54Z,use_quota=True,user_id='9bae8baabd6548ae87a78590fee7ba8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe52b8e-9f46-4b33-be3b-343a207eb9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe52b8e-9f46-4b33-be3b-343a207eb9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0bfb23e-947a-4637-ae85-210d100badde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0bfb23e-947a-4637-ae85-210d100badde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdb152ef-1e86-4025-bd08-5e9e4282ed8e', 'volume_name': 'volume-cdb152ef-1e86-4025-bd08-5e9e4282ed8e', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c0ff1f-0557-4708-a23a-217be1d2d233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c0ff1f-0557-4708-a23a-217be1d2d233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1f20e2-1d0f-49ca-9865-b3ab21f414c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:54 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Volume cdb152ef-1e86-4025-bd08-5e9e4282ed8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdb152ef-1e86-4025-bd08-5e9e4282ed8e', 'volume_size': 1} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fb2e69be-c417-4a52-9143-9893fa326adc {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:54 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fb2e69be-c417-4a52-9143-9893fa326adc Jul 14 13:03:54 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:54 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fb2e69be-c417-4a52-9143-9893fa326adc" returned: 0 in 0.326s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.366s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-6534953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdb152ef-1e86-4025-bd08-5e9e4282ed8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b08131aed44d59866c04dc8bb1090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:54Z,use_quota=True,user_id='9bae8baabd6548ae87a78590fee7ba8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Creating volume cdb152ef-1e86-4025-bd08-5e9e4282ed8e {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:03:54 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cdb152ef-1e86-4025-bd08-5e9e4282ed8e 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:03:54 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cdb152ef-1e86-4025-bd08-5e9e4282ed8e 1073741824 Jul 14 13:03:54 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Flow 'volume_create_manager' (491bfcf1-a35f-4f75-bf4e-c13c005d4abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d12c8300-e334-423e-a559-4bf812a83ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d12c8300-e334-423e-a559-4bf812a83ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1883645598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa35f4bc-7c7c-49f2-968c-2930ae106e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b08131aed44d59866c04dc8bb1090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:54Z,use_quota=True,user_id='9bae8baabd6548ae87a78590fee7ba8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d399a7-6300-489f-896c-9b643e84ca31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d399a7-6300-489f-896c-9b643e84ca31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b258a200-848d-413d-94d6-86ba94d1657f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b258a200-848d-413d-94d6-86ba94d1657f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa35f4bc-7c7c-49f2-968c-2930ae106e9e', 'volume_name': 'volume-fa35f4bc-7c7c-49f2-968c-2930ae106e9e', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f79bc2ed-f48a-4907-b16c-40fb65fcf5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f79bc2ed-f48a-4907-b16c-40fb65fcf5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (472b603b-1aef-4fa4-adb7-96f7b06bef0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:54 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Volume fa35f4bc-7c7c-49f2-968c-2930ae106e9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa35f4bc-7c7c-49f2-968c-2930ae106e9e', 'volume_size': 1} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb8f14a-dfaf-48c2-b993-ea39888be098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2e69be-c417-4a52-9143-9893fa326adc', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4168a27f-e1dc-4f54-88c9-ed23e1054bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:54 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Volume volume-fb2e69be-c417-4a52-9143-9893fa326adc (fb2e69be-c417-4a52-9143-9893fa326adc): created successfully Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4168a27f-e1dc-4f54-88c9-ed23e1054bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Flow 'volume_create_manager' (c0cd726f-1afc-4582-ae39-0acb636ff4e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:54 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-85aa7d10-b1dc-40e3-ba06-8b4550622734 tempest-VolumesGetTest-1140409626 None] Created volume successfully. Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Flow 'volume_create_manager' (4f3401f4-d878-4595-88c0-2c97e18cdb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf32aca4-2246-483f-9aad-48ef4e466c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf32aca4-2246-483f-9aad-48ef4e466c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-513781308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b08131aed44d59866c04dc8bb1090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:55Z,use_quota=True,user_id='9bae8baabd6548ae87a78590fee7ba8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aaca0f0-e52d-445c-800c-6abe9492889f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aaca0f0-e52d-445c-800c-6abe9492889f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dacb9a9-219c-4c07-86cd-9b7e43a8ddf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dacb9a9-219c-4c07-86cd-9b7e43a8ddf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd', 'volume_name': 'volume-1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5294a4-33e7-4bd3-8843-085119befe89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5294a4-33e7-4bd3-8843-085119befe89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a6ddff8-7765-4af1-97d8-a4190720a695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:55 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Volume 1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd', 'volume_size': 1} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:55 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cdb152ef-1e86-4025-bd08-5e9e4282ed8e 1073741824" returned: 0 in 0.768s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cdb152ef-1e86-4025-bd08-5e9e4282ed8e {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:55 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cdb152ef-1e86-4025-bd08-5e9e4282ed8e Jul 14 13:03:55 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-aafbca87-20c9-403a-b945-a9556e53c502 tempest-VolumesGetTest-1140409626 None] Acquiring lock "cinder-fb2e69be-c417-4a52-9143-9893fa326adc-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-aafbca87-20c9-403a-b945-a9556e53c502 tempest-VolumesGetTest-1140409626 None] Lock "cinder-fb2e69be-c417-4a52-9143-9893fa326adc-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-aafbca87-20c9-403a-b945-a9556e53c502 tempest-VolumesGetTest-1140409626 None] Acquiring lock "cinder-quobyte-fb2e69be-c417-4a52-9143-9893fa326adc" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Flow 'volume_create_manager' (56fadb9f-4806-446d-afaf-28974a7a498c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e4b7708-713b-4dc9-ac1e-06d43169b228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-aafbca87-20c9-403a-b945-a9556e53c502 tempest-VolumesGetTest-1140409626 None] Lock "cinder-quobyte-fb2e69be-c417-4a52-9143-9893fa326adc" acquired by "delete_volume" :: waited 0.094s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e4b7708-713b-4dc9-ac1e-06d43169b228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1195765799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7263d8e4-838e-4177-b08d-dee4486b43ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b08131aed44d59866c04dc8bb1090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:56Z,use_quota=True,user_id='9bae8baabd6548ae87a78590fee7ba8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64754cd4-f430-403d-be34-9d2c4507da62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:55 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64754cd4-f430-403d-be34-9d2c4507da62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e822846-3646-4dda-857c-6605d199023b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e822846-3646-4dda-857c-6605d199023b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7263d8e4-838e-4177-b08d-dee4486b43ec', 'volume_name': 'volume-7263d8e4-838e-4177-b08d-dee4486b43ec', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ffda173-7d82-4b68-93a4-8d9e59a86717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ffda173-7d82-4b68-93a4-8d9e59a86717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4ed19b-9e61-43c1-aa37-ebb7c778f61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:55 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Volume 7263d8e4-838e-4177-b08d-dee4486b43ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7263d8e4-838e-4177-b08d-dee4486b43ec', 'volume_size': 1} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[007e83d7-1e0b-49df-958c-b7dfa0b05c6b]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aafbca87-20c9-403a-b945-a9556e53c502 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fb2e69be-c417-4a52-9143-9893fa326adc {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cdb152ef-1e86-4025-bd08-5e9e4282ed8e" returned: 0 in 0.559s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.257s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1883645598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa35f4bc-7c7c-49f2-968c-2930ae106e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b08131aed44d59866c04dc8bb1090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:54Z,use_quota=True,user_id='9bae8baabd6548ae87a78590fee7ba8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Creating volume fa35f4bc-7c7c-49f2-968c-2930ae106e9e {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:03:55 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fa35f4bc-7c7c-49f2-968c-2930ae106e9e 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1f20e2-1d0f-49ca-9865-b3ab21f414c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdb152ef-1e86-4025-bd08-5e9e4282ed8e', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:55 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fa35f4bc-7c7c-49f2-968c-2930ae106e9e 1073741824 Jul 14 13:03:55 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18723a31-5fb2-41af-85a8-80f69f1d8221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:55 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Volume volume-cdb152ef-1e86-4025-bd08-5e9e4282ed8e (cdb152ef-1e86-4025-bd08-5e9e4282ed8e): created successfully Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18723a31-5fb2-41af-85a8-80f69f1d8221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Flow 'volume_create_manager' (fe93c77c-05a4-49fd-9ca7-bb09d0402dc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:55 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-ffccce16-6f6b-4b9a-a71b-d6366445f6cc tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Created volume successfully. Jul 14 13:03:56 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fb2e69be-c417-4a52-9143-9893fa326adc Jul 14 13:03:56 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Flow 'volume_create_manager' (ed779751-1f16-4cf8-b1b0-e0bfd71eefba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c90dc2-b329-4282-8dfa-e8af9377f10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c90dc2-b329-4282-8dfa-e8af9377f10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1794693231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dec74d7-5ebb-47ff-86e0-62a757d8e21c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b08131aed44d59866c04dc8bb1090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:56Z,use_quota=True,user_id='9bae8baabd6548ae87a78590fee7ba8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ece2b36-dd75-4706-bdd4-352834de92cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ece2b36-dd75-4706-bdd4-352834de92cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ca2063-4df2-43c4-bc5f-d59a3c4f8ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ca2063-4df2-43c4-bc5f-d59a3c4f8ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dec74d7-5ebb-47ff-86e0-62a757d8e21c', 'volume_name': 'volume-3dec74d7-5ebb-47ff-86e0-62a757d8e21c', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3db83a9-1bb6-41b9-bb99-3d7c5d117c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3db83a9-1bb6-41b9-bb99-3d7c5d117c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4cd2c7e-8179-4535-9a6a-39c1dea2e79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:56 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Volume 3dec74d7-5ebb-47ff-86e0-62a757d8e21c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dec74d7-5ebb-47ff-86e0-62a757d8e21c', 'volume_size': 1} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fc3272b1-7e45-4a32-a0ce-4ac1399414ff tempest-VolumesTestJSON-1819272233 None] Acquiring lock "cinder-be5a828f-061a-4e29-999b-e0ab43607839-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fc3272b1-7e45-4a32-a0ce-4ac1399414ff tempest-VolumesTestJSON-1819272233 None] Lock "cinder-be5a828f-061a-4e29-999b-e0ab43607839-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:56 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aafbca87-20c9-403a-b945-a9556e53c502 tempest-VolumesGetTest-1140409626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fb2e69be-c417-4a52-9143-9893fa326adc" returned: 0 in 0.543s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aafbca87-20c9-403a-b945-a9556e53c502 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fb2e69be-c417-4a52-9143-9893fa326adc {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:56 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fb2e69be-c417-4a52-9143-9893fa326adc Jul 14 13:03:56 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fc3272b1-7e45-4a32-a0ce-4ac1399414ff tempest-VolumesTestJSON-1819272233 None] Acquiring lock "cinder-quobyte-be5a828f-061a-4e29-999b-e0ab43607839" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fc3272b1-7e45-4a32-a0ce-4ac1399414ff tempest-VolumesTestJSON-1819272233 None] Lock "cinder-quobyte-be5a828f-061a-4e29-999b-e0ab43607839" acquired by "delete_volume" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98935aa-ac9f-4a2e-a813-55fa41472640]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc3272b1-7e45-4a32-a0ce-4ac1399414ff tempest-VolumesTestJSON-1819272233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be5a828f-061a-4e29-999b-e0ab43607839 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:56 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fa35f4bc-7c7c-49f2-968c-2930ae106e9e 1073741824" returned: 0 in 0.703s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fa35f4bc-7c7c-49f2-968c-2930ae106e9e {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:56 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be5a828f-061a-4e29-999b-e0ab43607839 Jul 14 13:03:56 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:56 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fa35f4bc-7c7c-49f2-968c-2930ae106e9e Jul 14 13:03:56 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:56 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aafbca87-20c9-403a-b945-a9556e53c502 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fb2e69be-c417-4a52-9143-9893fa326adc" returned: 0 in 0.381s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-aafbca87-20c9-403a-b945-a9556e53c502 tempest-VolumesGetTest-1140409626 None] Lock "cinder-quobyte-fb2e69be-c417-4a52-9143-9893fa326adc" released by "delete_volume" :: held 1.065s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-aafbca87-20c9-403a-b945-a9556e53c502 tempest-VolumesGetTest-1140409626 None] Created reservations ['ee3aeb86-0586-4242-9ab2-3d44d7f95380', '22152e4e-e2b5-4498-9b61-e62e73b644ff', 'd5f5a22d-5c7f-4274-9f13-fc8a23241afc', '16edcead-4633-425a-83cc-d9a859c52ab7'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aafbca87-20c9-403a-b945-a9556e53c502 tempest-VolumesGetTest-1140409626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aafbca87-20c9-403a-b945-a9556e53c502 tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-aafbca87-20c9-403a-b945-a9556e53c502 tempest-VolumesGetTest-1140409626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-aafbca87-20c9-403a-b945-a9556e53c502 tempest-VolumesGetTest-1140409626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aafbca87-20c9-403a-b945-a9556e53c502 tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aafbca87-20c9-403a-b945-a9556e53c502 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:56 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:56 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:03:56 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fa35f4bc-7c7c-49f2-968c-2930ae106e9e" returned: 0 in 0.323s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.888s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-513781308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b08131aed44d59866c04dc8bb1090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:55Z,use_quota=True,user_id='9bae8baabd6548ae87a78590fee7ba8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Creating volume 1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:03:56 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (472b603b-1aef-4fa4-adb7-96f7b06bef0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa35f4bc-7c7c-49f2-968c-2930ae106e9e', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:56 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241a98ce-d211-41dc-b055-b7f01a4afaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc3272b1-7e45-4a32-a0ce-4ac1399414ff tempest-VolumesTestJSON-1819272233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be5a828f-061a-4e29-999b-e0ab43607839" returned: 0 in 0.543s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc3272b1-7e45-4a32-a0ce-4ac1399414ff tempest-VolumesTestJSON-1819272233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be5a828f-061a-4e29-999b-e0ab43607839 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:57 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd 1073741824 Jul 14 13:03:57 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:57 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Volume volume-fa35f4bc-7c7c-49f2-968c-2930ae106e9e (fa35f4bc-7c7c-49f2-968c-2930ae106e9e): created successfully Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241a98ce-d211-41dc-b055-b7f01a4afaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:57 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be5a828f-061a-4e29-999b-e0ab43607839 Jul 14 13:03:57 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Flow 'volume_create_manager' (491bfcf1-a35f-4f75-bf4e-c13c005d4abc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:57 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-2c3a8b0f-15e2-4c22-b9ac-cc5325f24eaf tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Created volume successfully. Jul 14 13:03:57 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aafbca87-20c9-403a-b945-a9556e53c502 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.412s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-aafbca87-20c9-403a-b945-a9556e53c502 tempest-VolumesGetTest-1140409626 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:03:57 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-aafbca87-20c9-403a-b945-a9556e53c502 tempest-VolumesGetTest-1140409626 None] Deleted volume successfully. Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-aafbca87-20c9-403a-b945-a9556e53c502 tempest-VolumesGetTest-1140409626 None] Lock "cinder-fb2e69be-c417-4a52-9143-9893fa326adc-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:57 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc3272b1-7e45-4a32-a0ce-4ac1399414ff tempest-VolumesTestJSON-1819272233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be5a828f-061a-4e29-999b-e0ab43607839" returned: 0 in 0.387s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fc3272b1-7e45-4a32-a0ce-4ac1399414ff tempest-VolumesTestJSON-1819272233 None] Lock "cinder-quobyte-be5a828f-061a-4e29-999b-e0ab43607839" released by "delete_volume" :: held 0.974s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-fc3272b1-7e45-4a32-a0ce-4ac1399414ff tempest-VolumesTestJSON-1819272233 None] Created reservations ['6b0b4678-33e3-4325-a4fb-ccaa20d5c467', '5e905fd2-f98d-4cb3-ae1e-8a99a3f434ac', 'aea0ff19-67e6-49e3-920c-a32745b4feb5', '2533a140-48b3-4a9d-856b-d298d90b3cd9'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc3272b1-7e45-4a32-a0ce-4ac1399414ff tempest-VolumesTestJSON-1819272233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc3272b1-7e45-4a32-a0ce-4ac1399414ff tempest-VolumesTestJSON-1819272233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fc3272b1-7e45-4a32-a0ce-4ac1399414ff tempest-VolumesTestJSON-1819272233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fc3272b1-7e45-4a32-a0ce-4ac1399414ff tempest-VolumesTestJSON-1819272233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc3272b1-7e45-4a32-a0ce-4ac1399414ff tempest-VolumesTestJSON-1819272233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc3272b1-7e45-4a32-a0ce-4ac1399414ff tempest-VolumesTestJSON-1819272233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:57 devstack sudo[97114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:03:57 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:57 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd 1073741824" returned: 0 in 0.649s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:57 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd Jul 14 13:03:57 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:57 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc3272b1-7e45-4a32-a0ce-4ac1399414ff tempest-VolumesTestJSON-1819272233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.274s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-fc3272b1-7e45-4a32-a0ce-4ac1399414ff tempest-VolumesTestJSON-1819272233 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:03:57 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-fc3272b1-7e45-4a32-a0ce-4ac1399414ff tempest-VolumesTestJSON-1819272233 None] Deleted volume successfully. Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fc3272b1-7e45-4a32-a0ce-4ac1399414ff tempest-VolumesTestJSON-1819272233 None] Lock "cinder-be5a828f-061a-4e29-999b-e0ab43607839-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-74850298-6856-4b7b-9dd5-29b9f50800da tempest-VolumesGetTest-1140409626 None] Acquiring lock "cinder-00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-74850298-6856-4b7b-9dd5-29b9f50800da tempest-VolumesGetTest-1140409626 None] Lock "cinder-00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:57 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd" returned: 0 in 0.322s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.165s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1195765799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7263d8e4-838e-4177-b08d-dee4486b43ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b08131aed44d59866c04dc8bb1090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:56Z,use_quota=True,user_id='9bae8baabd6548ae87a78590fee7ba8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Creating volume 7263d8e4-838e-4177-b08d-dee4486b43ec {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:03:57 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:03:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7263d8e4-838e-4177-b08d-dee4486b43ec 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-74850298-6856-4b7b-9dd5-29b9f50800da tempest-VolumesGetTest-1140409626 None] Acquiring lock "cinder-quobyte-00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a6ddff8-7765-4af1-97d8-a4190720a695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:58 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7263d8e4-838e-4177-b08d-dee4486b43ec 1073741824 Jul 14 13:03:58 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8868dc-d8d7-45aa-b051-820d1d6ac8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-74850298-6856-4b7b-9dd5-29b9f50800da tempest-VolumesGetTest-1140409626 None] Lock "cinder-quobyte-00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b" acquired by "delete_volume" :: waited 0.032s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:58 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Volume volume-1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd (1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd): created successfully Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8868dc-d8d7-45aa-b051-820d1d6ac8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Flow 'volume_create_manager' (4f3401f4-d878-4595-88c0-2c97e18cdb8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c3db3c-bbe6-4e3e-9982-721b2be8d4ac]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-74850298-6856-4b7b-9dd5-29b9f50800da tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=173,cinder:UPDATE=237,cinder:INSERT=48,cinder:DELETE=21 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:03:58 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-425110b4-ce51-4024-987d-b0da859b6271 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Created volume successfully. Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=173,cinder:UPDATE=222,cinder:INSERT=57,cinder:DELETE=17 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:03:58 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b Jul 14 13:03:58 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:58 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:58 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-74850298-6856-4b7b-9dd5-29b9f50800da tempest-VolumesGetTest-1140409626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b" returned: 0 in 0.466s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-74850298-6856-4b7b-9dd5-29b9f50800da tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7263d8e4-838e-4177-b08d-dee4486b43ec 1073741824" returned: 0 in 0.574s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:58 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b Jul 14 13:03:58 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1a993458-7baa-4d1d-9369-1c7d879d4427 tempest-VolumesTestJSON-1819272233 None] Acquiring lock "cinder-41e122b8-ea51-4f43-bb69-d38e7bf5c0fe-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7263d8e4-838e-4177-b08d-dee4486b43ec {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1a993458-7baa-4d1d-9369-1c7d879d4427 tempest-VolumesTestJSON-1819272233 None] Lock "cinder-41e122b8-ea51-4f43-bb69-d38e7bf5c0fe-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:58 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7263d8e4-838e-4177-b08d-dee4486b43ec Jul 14 13:03:58 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1a993458-7baa-4d1d-9369-1c7d879d4427 tempest-VolumesTestJSON-1819272233 None] Acquiring lock "cinder-quobyte-41e122b8-ea51-4f43-bb69-d38e7bf5c0fe" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1a993458-7baa-4d1d-9369-1c7d879d4427 tempest-VolumesTestJSON-1819272233 None] Lock "cinder-quobyte-41e122b8-ea51-4f43-bb69-d38e7bf5c0fe" acquired by "delete_volume" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[093a7ebd-7358-4acd-a98b-14a76353e842]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1a993458-7baa-4d1d-9369-1c7d879d4427 tempest-VolumesTestJSON-1819272233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-41e122b8-ea51-4f43-bb69-d38e7bf5c0fe {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:58 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-41e122b8-ea51-4f43-bb69-d38e7bf5c0fe Jul 14 13:03:58 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:58 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-74850298-6856-4b7b-9dd5-29b9f50800da tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b" returned: 0 in 0.345s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-74850298-6856-4b7b-9dd5-29b9f50800da tempest-VolumesGetTest-1140409626 None] Lock "cinder-quobyte-00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b" released by "delete_volume" :: held 0.868s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:58 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7263d8e4-838e-4177-b08d-dee4486b43ec" returned: 0 in 0.324s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.722s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1794693231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dec74d7-5ebb-47ff-86e0-62a757d8e21c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91b08131aed44d59866c04dc8bb1090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:03:56Z,use_quota=True,user_id='9bae8baabd6548ae87a78590fee7ba8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Creating volume 3dec74d7-5ebb-47ff-86e0-62a757d8e21c {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:03:58 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:03:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3dec74d7-5ebb-47ff-86e0-62a757d8e21c 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4ed19b-9e61-43c1-aa37-ebb7c778f61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7263d8e4-838e-4177-b08d-dee4486b43ec', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (727b8014-62bf-4bd8-af9c-ec02ec9d7689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:59 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3dec74d7-5ebb-47ff-86e0-62a757d8e21c 1073741824 Jul 14 13:03:59 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-74850298-6856-4b7b-9dd5-29b9f50800da tempest-VolumesGetTest-1140409626 None] Created reservations ['cbc2cc13-80db-42a3-acd5-2a617aaabf36', '04be1763-e79a-4b3f-b4d5-e07f2162bc30', 'a482f8ea-0d75-405a-8892-9ece9bb6b65b', '01200855-c9d0-4eb7-b87f-3512adf5699d'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:59 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Volume volume-7263d8e4-838e-4177-b08d-dee4486b43ec (7263d8e4-838e-4177-b08d-dee4486b43ec): created successfully Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (727b8014-62bf-4bd8-af9c-ec02ec9d7689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Flow 'volume_create_manager' (56fadb9f-4806-446d-afaf-28974a7a498c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:59 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-66ee53ed-4ed3-4b49-b32a-c4b08c839ef1 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Created volume successfully. Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-74850298-6856-4b7b-9dd5-29b9f50800da tempest-VolumesGetTest-1140409626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-74850298-6856-4b7b-9dd5-29b9f50800da tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-74850298-6856-4b7b-9dd5-29b9f50800da tempest-VolumesGetTest-1140409626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-74850298-6856-4b7b-9dd5-29b9f50800da tempest-VolumesGetTest-1140409626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-74850298-6856-4b7b-9dd5-29b9f50800da tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-74850298-6856-4b7b-9dd5-29b9f50800da tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:59 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1a993458-7baa-4d1d-9369-1c7d879d4427 tempest-VolumesTestJSON-1819272233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-41e122b8-ea51-4f43-bb69-d38e7bf5c0fe" returned: 0 in 0.444s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1a993458-7baa-4d1d-9369-1c7d879d4427 tempest-VolumesTestJSON-1819272233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-41e122b8-ea51-4f43-bb69-d38e7bf5c0fe {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:59 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:03:59 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:59 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-41e122b8-ea51-4f43-bb69-d38e7bf5c0fe Jul 14 13:03:59 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:59 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-74850298-6856-4b7b-9dd5-29b9f50800da tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.297s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-74850298-6856-4b7b-9dd5-29b9f50800da tempest-VolumesGetTest-1140409626 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:03:59 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-74850298-6856-4b7b-9dd5-29b9f50800da tempest-VolumesGetTest-1140409626 None] Deleted volume successfully. Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-74850298-6856-4b7b-9dd5-29b9f50800da tempest-VolumesGetTest-1140409626 None] Lock "cinder-00f1c9ce-08f9-40fa-8e8a-aa43e8c0cd9b-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:59 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1a993458-7baa-4d1d-9369-1c7d879d4427 tempest-VolumesTestJSON-1819272233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-41e122b8-ea51-4f43-bb69-d38e7bf5c0fe" returned: 0 in 0.347s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1a993458-7baa-4d1d-9369-1c7d879d4427 tempest-VolumesTestJSON-1819272233 None] Lock "cinder-quobyte-41e122b8-ea51-4f43-bb69-d38e7bf5c0fe" released by "delete_volume" :: held 0.855s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3dec74d7-5ebb-47ff-86e0-62a757d8e21c 1073741824" returned: 0 in 0.606s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:59 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3dec74d7-5ebb-47ff-86e0-62a757d8e21c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-1a993458-7baa-4d1d-9369-1c7d879d4427 tempest-VolumesTestJSON-1819272233 None] Created reservations ['51147d57-9bf4-4c80-ab0e-5f9fd4020004', '052d6c10-fbef-4793-bd94-b1fa07655ea3', 'c5b3f020-97af-45b1-8c63-a103b2ca2bf1', '730c5a2a-1d62-4a12-81cd-6e7e949a4725'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:03:59 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3dec74d7-5ebb-47ff-86e0-62a757d8e21c Jul 14 13:03:59 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1a993458-7baa-4d1d-9369-1c7d879d4427 tempest-VolumesTestJSON-1819272233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1a993458-7baa-4d1d-9369-1c7d879d4427 tempest-VolumesTestJSON-1819272233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1a993458-7baa-4d1d-9369-1c7d879d4427 tempest-VolumesTestJSON-1819272233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1a993458-7baa-4d1d-9369-1c7d879d4427 tempest-VolumesTestJSON-1819272233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1a993458-7baa-4d1d-9369-1c7d879d4427 tempest-VolumesTestJSON-1819272233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1a993458-7baa-4d1d-9369-1c7d879d4427 tempest-VolumesTestJSON-1819272233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:03:59 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:03:59 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-91b68b76-ad9f-44e0-bccb-57d89ed6476c tempest-VolumesTestJSON-1819272233 None] Acquiring lock "cinder-cfba27f5-a3da-4096-946b-f9ef2e6261e7-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-91b68b76-ad9f-44e0-bccb-57d89ed6476c tempest-VolumesTestJSON-1819272233 None] Lock "cinder-cfba27f5-a3da-4096-946b-f9ef2e6261e7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-91b68b76-ad9f-44e0-bccb-57d89ed6476c tempest-VolumesTestJSON-1819272233 None] Acquiring lock "cinder-quobyte-cfba27f5-a3da-4096-946b-f9ef2e6261e7" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:03:59 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3dec74d7-5ebb-47ff-86e0-62a757d8e21c" returned: 0 in 0.294s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4cd2c7e-8179-4535-9a6a-39c1dea2e79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dec74d7-5ebb-47ff-86e0-62a757d8e21c', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1f873e-7304-402f-beb4-d7fb342f0370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-91b68b76-ad9f-44e0-bccb-57d89ed6476c tempest-VolumesTestJSON-1819272233 None] Lock "cinder-quobyte-cfba27f5-a3da-4096-946b-f9ef2e6261e7" acquired by "delete_volume" :: waited 0.038s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:03:59 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Volume volume-3dec74d7-5ebb-47ff-86e0-62a757d8e21c (3dec74d7-5ebb-47ff-86e0-62a757d8e21c): created successfully Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1f873e-7304-402f-beb4-d7fb342f0370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Flow 'volume_create_manager' (ed779751-1f16-4cf8-b1b0-e0bfd71eefba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc20466-f84c-41c6-ac18-d7480954a602]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:03:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-91b68b76-ad9f-44e0-bccb-57d89ed6476c tempest-VolumesTestJSON-1819272233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cfba27f5-a3da-4096-946b-f9ef2e6261e7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:00 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-03bbce56-03fe-47be-8a1e-f3a19e21b696 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Created volume successfully. Jul 14 13:04:00 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1a993458-7baa-4d1d-9369-1c7d879d4427 tempest-VolumesTestJSON-1819272233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.327s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:00 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-1a993458-7baa-4d1d-9369-1c7d879d4427 tempest-VolumesTestJSON-1819272233 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:04:00 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-1a993458-7baa-4d1d-9369-1c7d879d4427 tempest-VolumesTestJSON-1819272233 None] Deleted volume successfully. Jul 14 13:04:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1a993458-7baa-4d1d-9369-1c7d879d4427 tempest-VolumesTestJSON-1819272233 None] Lock "cinder-41e122b8-ea51-4f43-bb69-d38e7bf5c0fe-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:00 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cfba27f5-a3da-4096-946b-f9ef2e6261e7 Jul 14 13:04:00 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:00 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-91b68b76-ad9f-44e0-bccb-57d89ed6476c tempest-VolumesTestJSON-1819272233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cfba27f5-a3da-4096-946b-f9ef2e6261e7" returned: 0 in 0.457s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-91b68b76-ad9f-44e0-bccb-57d89ed6476c tempest-VolumesTestJSON-1819272233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cfba27f5-a3da-4096-946b-f9ef2e6261e7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:00 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cfba27f5-a3da-4096-946b-f9ef2e6261e7 Jul 14 13:04:00 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:00 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-91b68b76-ad9f-44e0-bccb-57d89ed6476c tempest-VolumesTestJSON-1819272233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cfba27f5-a3da-4096-946b-f9ef2e6261e7" returned: 0 in 0.293s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-91b68b76-ad9f-44e0-bccb-57d89ed6476c tempest-VolumesTestJSON-1819272233 None] Lock "cinder-quobyte-cfba27f5-a3da-4096-946b-f9ef2e6261e7" released by "delete_volume" :: held 0.807s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-19d90d1a-159c-4b18-b831-b9ca929617f6 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "cinder-3dec74d7-5ebb-47ff-86e0-62a757d8e21c-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-19d90d1a-159c-4b18-b831-b9ca929617f6 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-3dec74d7-5ebb-47ff-86e0-62a757d8e21c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-19d90d1a-159c-4b18-b831-b9ca929617f6 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "cinder-quobyte-3dec74d7-5ebb-47ff-86e0-62a757d8e21c" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:00 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-91b68b76-ad9f-44e0-bccb-57d89ed6476c tempest-VolumesTestJSON-1819272233 None] Created reservations ['c6ad8a33-8bc7-4416-b3a4-1a3a08974236', 'a6e63f1b-fd5c-47d7-9a65-b7c499cd93f4', 'e4c3ddd2-0bdd-407d-8a59-c77e59faf4ac', '6aed50ee-1994-4492-a6f1-eda164b826ad'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:04:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-19d90d1a-159c-4b18-b831-b9ca929617f6 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-quobyte-3dec74d7-5ebb-47ff-86e0-62a757d8e21c" acquired by "delete_volume" :: waited 0.042s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:00 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:04:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Flow 'volume_create_manager' (71f2628e-9c5a-4b78-9ae3-2ae7b76d3474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:04:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3602264c-38d6-4170-b4a1-bc1ac8804ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:00 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c317097-721b-45e2-a549-42b5de336efe]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-19d90d1a-159c-4b18-b831-b9ca929617f6 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3dec74d7-5ebb-47ff-86e0-62a757d8e21c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3602264c-38d6-4170-b4a1-bc1ac8804ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-672899483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955f39ed-a3f5-4403-b770-94b31a97c066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7351525e771449c592e2b68b78b6b101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:04:01Z,use_quota=True,user_id='699562c26b874be9b7ce45a20d384408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2921a00c-2295-4b77-b1c6-a2491ab250ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2921a00c-2295-4b77-b1c6-a2491ab250ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a93e142-2ef5-482f-968c-584b0b14b58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a93e142-2ef5-482f-968c-584b0b14b58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '955f39ed-a3f5-4403-b770-94b31a97c066', 'volume_name': 'volume-955f39ed-a3f5-4403-b770-94b31a97c066', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7b23b3-4198-4b52-b3ec-aa3288709955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7b23b3-4198-4b52-b3ec-aa3288709955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b445e8-3a61-4c83-a784-907bcd4b21b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:01 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Volume 955f39ed-a3f5-4403-b770-94b31a97c066: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-955f39ed-a3f5-4403-b770-94b31a97c066', 'volume_size': 1} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-672899483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955f39ed-a3f5-4403-b770-94b31a97c066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7351525e771449c592e2b68b78b6b101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:04:01Z,use_quota=True,user_id='699562c26b874be9b7ce45a20d384408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Creating volume 955f39ed-a3f5-4403-b770-94b31a97c066 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:04:01 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:01 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066 1073741824 Jul 14 13:04:01 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-91b68b76-ad9f-44e0-bccb-57d89ed6476c tempest-VolumesTestJSON-1819272233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-91b68b76-ad9f-44e0-bccb-57d89ed6476c tempest-VolumesTestJSON-1819272233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-91b68b76-ad9f-44e0-bccb-57d89ed6476c tempest-VolumesTestJSON-1819272233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-91b68b76-ad9f-44e0-bccb-57d89ed6476c tempest-VolumesTestJSON-1819272233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-91b68b76-ad9f-44e0-bccb-57d89ed6476c tempest-VolumesTestJSON-1819272233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-91b68b76-ad9f-44e0-bccb-57d89ed6476c tempest-VolumesTestJSON-1819272233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:01 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3dec74d7-5ebb-47ff-86e0-62a757d8e21c Jul 14 13:04:01 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:01 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:04:01 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:01 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-19d90d1a-159c-4b18-b831-b9ca929617f6 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3dec74d7-5ebb-47ff-86e0-62a757d8e21c" returned: 0 in 0.413s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-19d90d1a-159c-4b18-b831-b9ca929617f6 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3dec74d7-5ebb-47ff-86e0-62a757d8e21c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:01 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-91b68b76-ad9f-44e0-bccb-57d89ed6476c tempest-VolumesTestJSON-1819272233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.300s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-91b68b76-ad9f-44e0-bccb-57d89ed6476c tempest-VolumesTestJSON-1819272233 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:04:01 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-91b68b76-ad9f-44e0-bccb-57d89ed6476c tempest-VolumesTestJSON-1819272233 None] Deleted volume successfully. Jul 14 13:04:01 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3dec74d7-5ebb-47ff-86e0-62a757d8e21c Jul 14 13:04:01 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-91b68b76-ad9f-44e0-bccb-57d89ed6476c tempest-VolumesTestJSON-1819272233 None] Lock "cinder-cfba27f5-a3da-4096-946b-f9ef2e6261e7-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:01 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066 1073741824" returned: 0 in 0.494s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:01 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066 Jul 14 13:04:01 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:01 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-19d90d1a-159c-4b18-b831-b9ca929617f6 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3dec74d7-5ebb-47ff-86e0-62a757d8e21c" returned: 0 in 0.276s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-19d90d1a-159c-4b18-b831-b9ca929617f6 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-quobyte-3dec74d7-5ebb-47ff-86e0-62a757d8e21c" released by "delete_volume" :: held 0.776s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-19d90d1a-159c-4b18-b831-b9ca929617f6 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Created reservations ['2bce4d33-af5a-4835-9df5-4f80818a0f23', '604aadac-44fe-4e9c-a7c9-f812a0bb0b77', 'a2e34206-cb18-4067-94d8-5714cfb2a599', 'bee645d8-fb5c-4d2e-ada9-ea5f49b3c26e'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-19d90d1a-159c-4b18-b831-b9ca929617f6 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-19d90d1a-159c-4b18-b831-b9ca929617f6 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-19d90d1a-159c-4b18-b831-b9ca929617f6 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-19d90d1a-159c-4b18-b831-b9ca929617f6 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-19d90d1a-159c-4b18-b831-b9ca929617f6 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-19d90d1a-159c-4b18-b831-b9ca929617f6 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:01 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066" returned: 0 in 0.262s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:01 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:04:01 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b445e8-3a61-4c83-a784-907bcd4b21b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-955f39ed-a3f5-4403-b770-94b31a97c066', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccdab0d6-21c5-4e42-b09c-f34ead6cc1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:01 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Volume volume-955f39ed-a3f5-4403-b770-94b31a97c066 (955f39ed-a3f5-4403-b770-94b31a97c066): created successfully Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccdab0d6-21c5-4e42-b09c-f34ead6cc1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Flow 'volume_create_manager' (71f2628e-9c5a-4b78-9ae3-2ae7b76d3474) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:04:01 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c5221677-96a3-4dd5-aeae-6688cd9e8802 tempest-VolumesGetTest-1140409626 None] Created volume successfully. Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-381f8404-34f6-44bf-9800-838bef7212b0 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "cinder-7263d8e4-838e-4177-b08d-dee4486b43ec-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:01 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-381f8404-34f6-44bf-9800-838bef7212b0 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-7263d8e4-838e-4177-b08d-dee4486b43ec-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-381f8404-34f6-44bf-9800-838bef7212b0 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "cinder-quobyte-7263d8e4-838e-4177-b08d-dee4486b43ec" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-381f8404-34f6-44bf-9800-838bef7212b0 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-quobyte-7263d8e4-838e-4177-b08d-dee4486b43ec" acquired by "delete_volume" :: waited 0.020s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:02 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[544a8d19-de17-49b3-bbe4-750edf796cf1]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-381f8404-34f6-44bf-9800-838bef7212b0 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7263d8e4-838e-4177-b08d-dee4486b43ec {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:02 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-19d90d1a-159c-4b18-b831-b9ca929617f6 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.298s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:02 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-19d90d1a-159c-4b18-b831-b9ca929617f6 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:04:02 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-19d90d1a-159c-4b18-b831-b9ca929617f6 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Deleted volume successfully. Jul 14 13:04:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-19d90d1a-159c-4b18-b831-b9ca929617f6 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-3dec74d7-5ebb-47ff-86e0-62a757d8e21c-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:02 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7263d8e4-838e-4177-b08d-dee4486b43ec Jul 14 13:04:02 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:02 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-381f8404-34f6-44bf-9800-838bef7212b0 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7263d8e4-838e-4177-b08d-dee4486b43ec" returned: 0 in 0.445s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-381f8404-34f6-44bf-9800-838bef7212b0 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7263d8e4-838e-4177-b08d-dee4486b43ec {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:02 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7263d8e4-838e-4177-b08d-dee4486b43ec Jul 14 13:04:02 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:02 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-381f8404-34f6-44bf-9800-838bef7212b0 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7263d8e4-838e-4177-b08d-dee4486b43ec" returned: 0 in 0.291s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-381f8404-34f6-44bf-9800-838bef7212b0 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-quobyte-7263d8e4-838e-4177-b08d-dee4486b43ec" released by "delete_volume" :: held 0.786s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:02 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-381f8404-34f6-44bf-9800-838bef7212b0 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Created reservations ['f7fb2597-fe14-49e2-9c37-7cdd22dc29f9', '259fd982-d306-4ddb-8a87-9e60426e6ef7', 'b00ed071-6d7d-439b-8777-18995778797a', '5c645d7e-caa5-4fae-bc43-97f943082046'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:04:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-381f8404-34f6-44bf-9800-838bef7212b0 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-381f8404-34f6-44bf-9800-838bef7212b0 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-381f8404-34f6-44bf-9800-838bef7212b0 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-381f8404-34f6-44bf-9800-838bef7212b0 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-381f8404-34f6-44bf-9800-838bef7212b0 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-381f8404-34f6-44bf-9800-838bef7212b0 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:02 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:04:02 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ff892d90-5df5-4b68-8f5c-f1d2cb5876ff tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "cinder-1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ff892d90-5df5-4b68-8f5c-f1d2cb5876ff tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ff892d90-5df5-4b68-8f5c-f1d2cb5876ff tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "cinder-quobyte-1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:03 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-381f8404-34f6-44bf-9800-838bef7212b0 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.346s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-381f8404-34f6-44bf-9800-838bef7212b0 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:04:03 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-381f8404-34f6-44bf-9800-838bef7212b0 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Deleted volume successfully. Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ff892d90-5df5-4b68-8f5c-f1d2cb5876ff tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-quobyte-1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd" acquired by "delete_volume" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c07e5e-e513-4de1-8a72-e9c5483db339]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ff892d90-5df5-4b68-8f5c-f1d2cb5876ff tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-381f8404-34f6-44bf-9800-838bef7212b0 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-7263d8e4-838e-4177-b08d-dee4486b43ec-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:03 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd Jul 14 13:04:03 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Flow 'volume_create_manager' (cbb54e26-07b6-4175-a605-a52f877d6bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe761ab-09fc-4585-be98-ef314f0d6e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe761ab-09fc-4585-be98-ef314f0d6e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2134393861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5cb0018-c38d-441f-b20a-9cfecf22fa96,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7351525e771449c592e2b68b78b6b101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=955f39ed-a3f5-4403-b770-94b31a97c066,status='creating',terminated_at=None,updated_at=2026-07-14T11:04:04Z,use_quota=True,user_id='699562c26b874be9b7ce45a20d384408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c15c931-2dd9-4fbb-996e-52fdbf6144ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c15c931-2dd9-4fbb-996e-52fdbf6144ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab698a88-507e-42d9-a05e-5bbec370a41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab698a88-507e-42d9-a05e-5bbec370a41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd5cb0018-c38d-441f-b20a-9cfecf22fa96', 'volume_name': 'volume-d5cb0018-c38d-441f-b20a-9cfecf22fa96', 'volume_size': 1, 'source_volid': '955f39ed-a3f5-4403-b770-94b31a97c066', 'source_volstatus': 'available'}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4696c644-e60b-4b02-ab2c-2b0993c15c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4696c644-e60b-4b02-ab2c-2b0993c15c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970e9b3c-5cbd-41b0-9bb6-707f16d65e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:03 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Volume d5cb0018-c38d-441f-b20a-9cfecf22fa96: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d5cb0018-c38d-441f-b20a-9cfecf22fa96', 'volume_size': 1, 'source_volid': '955f39ed-a3f5-4403-b770-94b31a97c066', 'source_volstatus': 'available'} Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:03 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Cloning volume 955f39ed-a3f5-4403-b770-94b31a97c066 to volume d5cb0018-c38d-441f-b20a-9cfecf22fa96 Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Creating offline snapshot a7d1e060-da30-40d6-8d51-46d3cae322a0 of volume 955f39ed-a3f5-4403-b770-94b31a97c066 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf90cd5-7d66-490e-bb75-fce7e94d65e2]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:03 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ff892d90-5df5-4b68-8f5c-f1d2cb5876ff tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd" returned: 0 in 0.473s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ff892d90-5df5-4b68-8f5c-f1d2cb5876ff tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:03 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd Jul 14 13:04:03 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:03 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066 Jul 14 13:04:03 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:04 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ff892d90-5df5-4b68-8f5c-f1d2cb5876ff tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd" returned: 0 in 0.394s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:04 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ff892d90-5df5-4b68-8f5c-f1d2cb5876ff tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-quobyte-1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd" released by "delete_volume" :: held 0.963s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:04 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-ff892d90-5df5-4b68-8f5c-f1d2cb5876ff tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Created reservations ['6ab024bd-26c7-47b1-aa03-5a5b18b2772f', 'e0747bbd-4a2e-48fe-a47f-d3e0bf50cd91', '9a32e860-557e-4de6-b77f-b440b7f1e0fd', '500c2828-1c97-46de-b366-dcc23f46c1be'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:04:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ff892d90-5df5-4b68-8f5c-f1d2cb5876ff tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ff892d90-5df5-4b68-8f5c-f1d2cb5876ff tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ff892d90-5df5-4b68-8f5c-f1d2cb5876ff tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:04 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ff892d90-5df5-4b68-8f5c-f1d2cb5876ff tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ff892d90-5df5-4b68-8f5c-f1d2cb5876ff tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ff892d90-5df5-4b68-8f5c-f1d2cb5876ff tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066" returned: 0 in 0.638s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:04 devstack sudo[97253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:04:04 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:04 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0 1G Jul 14 13:04:04 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:04 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ff892d90-5df5-4b68-8f5c-f1d2cb5876ff tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.287s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:04 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-ff892d90-5df5-4b68-8f5c-f1d2cb5876ff tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:04:04 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-ff892d90-5df5-4b68-8f5c-f1d2cb5876ff tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Deleted volume successfully. Jul 14 13:04:04 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ff892d90-5df5-4b68-8f5c-f1d2cb5876ff tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-1f6b8ff8-9e02-49c2-8c46-eba5a271ccfd-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:04 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0 1G" returned: 0 in 0.505s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-955f39ed-a3f5-4403-b770-94b31a97c066 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:04 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-955f39ed-a3f5-4403-b770-94b31a97c066 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0 Jul 14 13:04:04 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:05 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-955f39ed-a3f5-4403-b770-94b31a97c066 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0" returned: 0 in 0.327s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:05 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0 is being set with open permissions: ugo+rw Jul 14 13:04:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:05 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0 Jul 14 13:04:05 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:05 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5ade5a4a-c046-488e-8196-680f61187459 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "cinder-fa35f4bc-7c7c-49f2-968c-2930ae106e9e-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:05 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5ade5a4a-c046-488e-8196-680f61187459 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-fa35f4bc-7c7c-49f2-968c-2930ae106e9e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:05 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5ade5a4a-c046-488e-8196-680f61187459 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "cinder-quobyte-fa35f4bc-7c7c-49f2-968c-2930ae106e9e" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:05 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5ade5a4a-c046-488e-8196-680f61187459 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-quobyte-fa35f4bc-7c7c-49f2-968c-2930ae106e9e" acquired by "delete_volume" :: waited 0.036s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:05 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0" returned: 0 in 0.391s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:05 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9d9b6f-8756-47b6-8905-5c382ce90ec0]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5ade5a4a-c046-488e-8196-680f61187459 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fa35f4bc-7c7c-49f2-968c-2930ae106e9e {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:05 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.info Jul 14 13:04:05 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:05 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fa35f4bc-7c7c-49f2-968c-2930ae106e9e Jul 14 13:04:05 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:06 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.info" returned: 0 in 0.298s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:06 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.info is being set with open permissions: ugo+rw Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:06 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.info Jul 14 13:04:06 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:06 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5ade5a4a-c046-488e-8196-680f61187459 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fa35f4bc-7c7c-49f2-968c-2930ae106e9e" returned: 0 in 0.435s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5ade5a4a-c046-488e-8196-680f61187459 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fa35f4bc-7c7c-49f2-968c-2930ae106e9e {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:06 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fa35f4bc-7c7c-49f2-968c-2930ae106e9e Jul 14 13:04:06 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:06 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.info" returned: 0 in 0.318s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Acquiring lock "cinder-quobyte-d5cb0018-c38d-441f-b20a-9cfecf22fa96" by "_copy_volume_from_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Lock "cinder-quobyte-d5cb0018-c38d-441f-b20a-9cfecf22fa96" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] snapshot: a7d1e060-da30-40d6-8d51-46d3cae322a0, volume: d5cb0018-c38d-441f-b20a-9cfecf22fa96, {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:06 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5ade5a4a-c046-488e-8196-680f61187459 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fa35f4bc-7c7c-49f2-968c-2930ae106e9e" returned: 0 in 0.302s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cff8486-e113-4b55-b2c6-bd01310ce550]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5ade5a4a-c046-488e-8196-680f61187459 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-quobyte-fa35f4bc-7c7c-49f2-968c-2930ae106e9e" released by "delete_volume" :: held 0.804s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-5ade5a4a-c046-488e-8196-680f61187459 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Created reservations ['b8ac27fa-c104-4787-afcc-c0d628c2dd1b', 'c26acbd0-9704-4f2c-93b2-36aed61117dd', 'f986a086-dee0-461b-b4d6-fad84952117b', '074b3d87-025e-4ecc-8ef4-718ac73479bf'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5ade5a4a-c046-488e-8196-680f61187459 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5ade5a4a-c046-488e-8196-680f61187459 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5ade5a4a-c046-488e-8196-680f61187459 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5ade5a4a-c046-488e-8196-680f61187459 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5ade5a4a-c046-488e-8196-680f61187459 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:06 devstack sudo[97287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0 Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5ade5a4a-c046-488e-8196-680f61187459 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:06 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:06 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:04:06 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c530009b-5e4f-4052-87b7-9acb0c1f1006 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "cinder-cdb152ef-1e86-4025-bd08-5e9e4282ed8e-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c530009b-5e4f-4052-87b7-9acb0c1f1006 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-cdb152ef-1e86-4025-bd08-5e9e4282ed8e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c530009b-5e4f-4052-87b7-9acb0c1f1006 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "cinder-quobyte-cdb152ef-1e86-4025-bd08-5e9e4282ed8e" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c530009b-5e4f-4052-87b7-9acb0c1f1006 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-quobyte-cdb152ef-1e86-4025-bd08-5e9e4282ed8e" acquired by "delete_volume" :: waited 0.027s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:07 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0" returned: 0 in 0.595s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:07 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-955f39ed-a3f5-4403-b770-94b31a97c066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:04:07 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066 {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 13:04:07 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Creating direct copy from snapshot {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 13:04:07 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03b5b53-6f60-49da-b747-216317009b82]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c530009b-5e4f-4052-87b7-9acb0c1f1006 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cdb152ef-1e86-4025-bd08-5e9e4282ed8e {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:07 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[a195360a-48cc-46b4-a073-a16b0d15330c]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:07 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5ade5a4a-c046-488e-8196-680f61187459 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.488s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:07 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-5ade5a4a-c046-488e-8196-680f61187459 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:04:07 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-5ade5a4a-c046-488e-8196-680f61187459 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Deleted volume successfully. Jul 14 13:04:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5ade5a4a-c046-488e-8196-680f61187459 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-fa35f4bc-7c7c-49f2-968c-2930ae106e9e-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:07 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066 Jul 14 13:04:07 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:07 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cdb152ef-1e86-4025-bd08-5e9e4282ed8e Jul 14 13:04:07 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:07 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:07 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c530009b-5e4f-4052-87b7-9acb0c1f1006 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cdb152ef-1e86-4025-bd08-5e9e4282ed8e" returned: 0 in 0.509s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c530009b-5e4f-4052-87b7-9acb0c1f1006 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cdb152ef-1e86-4025-bd08-5e9e4282ed8e {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066" returned: 0 in 0.504s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:07 devstack cinder-volume[86977]: DEBUG cinder.utils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Path /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d5cb0018-c38d-441f-b20a-9cfecf22fa96 not found in is_blk_device check {{(pid=86977) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 13:04:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d5cb0018-c38d-441f-b20a-9cfecf22fa96 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:07 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cdb152ef-1e86-4025-bd08-5e9e4282ed8e Jul 14 13:04:07 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:07 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d5cb0018-c38d-441f-b20a-9cfecf22fa96 Jul 14 13:04:07 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:07 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c530009b-5e4f-4052-87b7-9acb0c1f1006 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-cdb152ef-1e86-4025-bd08-5e9e4282ed8e" returned: 0 in 0.316s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c530009b-5e4f-4052-87b7-9acb0c1f1006 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-quobyte-cdb152ef-1e86-4025-bd08-5e9e4282ed8e" released by "delete_volume" :: held 0.883s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:07 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-c530009b-5e4f-4052-87b7-9acb0c1f1006 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Created reservations ['affd2aad-3563-4f5d-b5ad-b4008c776d30', '4a009313-5530-4d61-99d6-f224a0f9706f', 'd2fdf9ca-8bd0-427a-aa0e-94c3e4294868', '91872334-3c91-4f5b-80f3-55a534217307'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:04:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c530009b-5e4f-4052-87b7-9acb0c1f1006 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c530009b-5e4f-4052-87b7-9acb0c1f1006 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:08 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c530009b-5e4f-4052-87b7-9acb0c1f1006 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:08 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c530009b-5e4f-4052-87b7-9acb0c1f1006 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c530009b-5e4f-4052-87b7-9acb0c1f1006 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c530009b-5e4f-4052-87b7-9acb0c1f1006 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:08 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:04:08 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:08 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-765cd899-11bd-4bce-880b-5bc71fb50bd3 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "cinder-b9e0d7e8-dc73-4a16-b873-0ddf7bc92211-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:08 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-765cd899-11bd-4bce-880b-5bc71fb50bd3 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-b9e0d7e8-dc73-4a16-b873-0ddf7bc92211-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:08 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-765cd899-11bd-4bce-880b-5bc71fb50bd3 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "cinder-quobyte-b9e0d7e8-dc73-4a16-b873-0ddf7bc92211" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:08 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-765cd899-11bd-4bce-880b-5bc71fb50bd3 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-quobyte-b9e0d7e8-dc73-4a16-b873-0ddf7bc92211" acquired by "delete_volume" :: waited 0.039s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:08 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ddca9d-8326-4728-99ee-be03921e699d]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-765cd899-11bd-4bce-880b-5bc71fb50bd3 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9e0d7e8-dc73-4a16-b873-0ddf7bc92211 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:08 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c530009b-5e4f-4052-87b7-9acb0c1f1006 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.644s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:08 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-c530009b-5e4f-4052-87b7-9acb0c1f1006 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:04:08 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c530009b-5e4f-4052-87b7-9acb0c1f1006 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Deleted volume successfully. Jul 14 13:04:08 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c530009b-5e4f-4052-87b7-9acb0c1f1006 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-cdb152ef-1e86-4025-bd08-5e9e4282ed8e-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:08 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9e0d7e8-dc73-4a16-b873-0ddf7bc92211 Jul 14 13:04:08 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:09 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-765cd899-11bd-4bce-880b-5bc71fb50bd3 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9e0d7e8-dc73-4a16-b873-0ddf7bc92211" returned: 0 in 1.128s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-765cd899-11bd-4bce-880b-5bc71fb50bd3 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9e0d7e8-dc73-4a16-b873-0ddf7bc92211 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:09 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9e0d7e8-dc73-4a16-b873-0ddf7bc92211 Jul 14 13:04:09 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:10 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-765cd899-11bd-4bce-880b-5bc71fb50bd3 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9e0d7e8-dc73-4a16-b873-0ddf7bc92211" returned: 0 in 0.619s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-765cd899-11bd-4bce-880b-5bc71fb50bd3 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-quobyte-b9e0d7e8-dc73-4a16-b873-0ddf7bc92211" released by "delete_volume" :: held 1.894s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:10 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-765cd899-11bd-4bce-880b-5bc71fb50bd3 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Created reservations ['26ed3afa-ec38-43fe-ad33-a600511483a0', '7836492c-108e-49f6-9e99-0d56379af391', '2f34a06d-ae66-4d1c-b519-a1f6aba15e02', '73fc628d-3d81-467d-99d7-01a08043d247'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:04:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-765cd899-11bd-4bce-880b-5bc71fb50bd3 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-765cd899-11bd-4bce-880b-5bc71fb50bd3 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-765cd899-11bd-4bce-880b-5bc71fb50bd3 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-765cd899-11bd-4bce-880b-5bc71fb50bd3 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-765cd899-11bd-4bce-880b-5bc71fb50bd3 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-765cd899-11bd-4bce-880b-5bc71fb50bd3 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:10 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:04:10 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:11 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-765cd899-11bd-4bce-880b-5bc71fb50bd3 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.647s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:11 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-765cd899-11bd-4bce-880b-5bc71fb50bd3 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:04:11 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-765cd899-11bd-4bce-880b-5bc71fb50bd3 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Deleted volume successfully. Jul 14 13:04:11 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-765cd899-11bd-4bce-880b-5bc71fb50bd3 tempest-CreateVolumesFromSourceVolumeTest-1480870071 None] Lock "cinder-b9e0d7e8-dc73-4a16-b873-0ddf7bc92211-delete_volume" released by "delete_volume" :: held 3.115s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:13 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d5cb0018-c38d-441f-b20a-9cfecf22fa96" returned: 0 in 6.055s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:13 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c426d83-427d-4fb7-ad25-3df4eb3680c9]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:13 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066 Jul 14 13:04:13 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:14 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066" returned: 0 in 0.670s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:14 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Image conversion details: src /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d5cb0018-c38d-441f-b20a-9cfecf22fa96 {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:04:14 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Converted 1024.00 MB image at 169.11 MB/s Jul 14 13:04:14 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d5cb0018-c38d-441f-b20a-9cfecf22fa96 is being set with open permissions: ugo+rw Jul 14 13:04:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d5cb0018-c38d-441f-b20a-9cfecf22fa96 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:14 devstack sudo[97342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d5cb0018-c38d-441f-b20a-9cfecf22fa96 Jul 14 13:04:14 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:14 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d5cb0018-c38d-441f-b20a-9cfecf22fa96" returned: 0 in 0.264s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Lock "cinder-quobyte-d5cb0018-c38d-441f-b20a-9cfecf22fa96" released by "_copy_volume_from_snapshot" :: held 8.218s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Acquiring lock "cinder-quobyte-a7d1e060-da30-40d6-8d51-46d3cae322a0" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Lock "cinder-quobyte-a7d1e060-da30-40d6-8d51-46d3cae322a0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Deleting offline snapshot a7d1e060-da30-40d6-8d51-46d3cae322a0 of volume 955f39ed-a3f5-4403-b770-94b31a97c066 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:04:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] snapshot_file for this snap is: volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:04:14 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[0102cc30-9f9a-42a3-83a6-c9a0af672455]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:14 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0 Jul 14 13:04:14 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:15 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0" returned: 0 in 0.393s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-955f39ed-a3f5-4403-b770-94b31a97c066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:04:15 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[004132f0-c935-4f66-adda-646a3fd20fc6]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:15 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066 Jul 14 13:04:15 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:15 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066" returned: 0 in 0.477s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:15 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0 Jul 14 13:04:15 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:16 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0" returned: 0 in 0.493s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:16 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0 Jul 14 13:04:16 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:16 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066.a7d1e060-da30-40d6-8d51-46d3cae322a0" returned: 0 in 0.321s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Lock "cinder-quobyte-a7d1e060-da30-40d6-8d51-46d3cae322a0" released by "_delete_snapshot" :: held 1.803s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.769s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:04:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970e9b3c-5cbd-41b0-9bb6-707f16d65e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5cb0018-c38d-441f-b20a-9cfecf22fa96', 'volume_size': 1, 'source_volid': '955f39ed-a3f5-4403-b770-94b31a97c066', 'source_volstatus': 'available'}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:16 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:04:16 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (786d935e-ca88-4021-97d8-1247270e6063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:16 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Volume volume-d5cb0018-c38d-441f-b20a-9cfecf22fa96 (d5cb0018-c38d-441f-b20a-9cfecf22fa96): created successfully Jul 14 13:04:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (786d935e-ca88-4021-97d8-1247270e6063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Flow 'volume_create_manager' (cbb54e26-07b6-4175-a605-a52f877d6bc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:04:16 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c940a8e3-c384-4a94-9339-ee0d36b7ff16 tempest-VolumesGetTest-1140409626 None] Created volume successfully. Jul 14 13:04:16 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-517514f0-1413-45ff-aef0-785bd8094528 tempest-GroupSnapshotsV319Test-208110514 None] Group tempest-GroupSnapshotsV319Test-Group-1811574865: creating Jul 14 13:04:16 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-517514f0-1413-45ff-aef0-785bd8094528 tempest-GroupSnapshotsV319Test-208110514 None] Group tempest-GroupSnapshotsV319Test-Group-1811574865: created successfully Jul 14 13:04:16 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-517514f0-1413-45ff-aef0-785bd8094528 tempest-GroupSnapshotsV319Test-208110514 None] Create group completed successfully. Jul 14 13:04:16 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.408s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:04:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:04:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 28 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 13:04:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Flow 'volume_create_manager' (fb9ed040-a4e7-4595-87b9-6ef2d75a9add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52597099-a014-48bd-9fdd-28f67dbf2aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52597099-a014-48bd-9fdd-28f67dbf2aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:04:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1557887530',display_name='tempest-VolumesGetTest-Volume-671318370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfba0819-aa00-4980-88d8-9472aa65d557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7351525e771449c592e2b68b78b6b101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:04:18Z,use_quota=True,user_id='699562c26b874be9b7ce45a20d384408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a51183-4a80-412b-9e04-f5b9563fca8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a51183-4a80-412b-9e04-f5b9563fca8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (608f57ff-49c9-434f-a36c-d3c3c0313021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (608f57ff-49c9-434f-a36c-d3c3c0313021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfba0819-aa00-4980-88d8-9472aa65d557', 'volume_name': 'volume-dfba0819-aa00-4980-88d8-9472aa65d557', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71223eab-1759-4305-8a59-2fb04a31784a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71223eab-1759-4305-8a59-2fb04a31784a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d3c231d-121e-4ba9-a487-1af160739738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:18 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Volume dfba0819-aa00-4980-88d8-9472aa65d557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfba0819-aa00-4980-88d8-9472aa65d557', 'volume_size': 1} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:04:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1557887530',display_name='tempest-VolumesGetTest-Volume-671318370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfba0819-aa00-4980-88d8-9472aa65d557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7351525e771449c592e2b68b78b6b101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:04:18Z,use_quota=True,user_id='699562c26b874be9b7ce45a20d384408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Creating volume dfba0819-aa00-4980-88d8-9472aa65d557 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:04:18 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfba0819-aa00-4980-88d8-9472aa65d557 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:18 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfba0819-aa00-4980-88d8-9472aa65d557 1073741824 Jul 14 13:04:18 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Flow 'volume_create_manager' (175a40b3-5ee1-4ecb-8e5b-afd9cd0446d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a713e69a-045c-4a92-85fc-824cf8d2637c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a713e69a-045c-4a92-85fc-824cf8d2637c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2071413679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a792955-4442-4b1a-96c9-8484eea3344a,host='devstack@QuobyteHD#QuobyteHD',id=a690ba23-b384-4278-b94a-00ab8cc3c590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ba1fb8421e543509148b85543b7278e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:04:19Z,use_quota=True,user_id='ee89d766fcd54d308d400c310412c5a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a3aeae6-721b-47c6-a51e-cf9157c3b6c2),volume_type_id=7a3aeae6-721b-47c6-a51e-cf9157c3b6c2)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809ffbf2-c859-4aa6-8c30-c5663d4cbf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809ffbf2-c859-4aa6-8c30-c5663d4cbf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7741f40c-e522-4f6d-be03-0032d64dde3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7741f40c-e522-4f6d-be03-0032d64dde3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a690ba23-b384-4278-b94a-00ab8cc3c590', 'volume_name': 'volume-a690ba23-b384-4278-b94a-00ab8cc3c590', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd3f9af-b1c5-4134-a771-77c53d6efcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd3f9af-b1c5-4134-a771-77c53d6efcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f99cf2-91b1-4136-ac40-a744344edc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:18 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Volume a690ba23-b384-4278-b94a-00ab8cc3c590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a690ba23-b384-4278-b94a-00ab8cc3c590', 'volume_size': 1} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:18 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfba0819-aa00-4980-88d8-9472aa65d557 1073741824" returned: 0 in 0.637s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfba0819-aa00-4980-88d8-9472aa65d557 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:18 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfba0819-aa00-4980-88d8-9472aa65d557 Jul 14 13:04:18 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:19 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfba0819-aa00-4980-88d8-9472aa65d557" returned: 0 in 0.325s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:04:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.441s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7a792955-4442-4b1a-96c9-8484eea3344a,created_at=2026-07-14T11:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2071413679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a792955-4442-4b1a-96c9-8484eea3344a,host='devstack@QuobyteHD#QuobyteHD',id=a690ba23-b384-4278-b94a-00ab8cc3c590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ba1fb8421e543509148b85543b7278e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:04:19Z,use_quota=True,user_id='ee89d766fcd54d308d400c310412c5a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a3aeae6-721b-47c6-a51e-cf9157c3b6c2),volume_type_id=7a3aeae6-721b-47c6-a51e-cf9157c3b6c2)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:04:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Creating volume a690ba23-b384-4278-b94a-00ab8cc3c590 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:04:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:04:19 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:04:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d3c231d-121e-4ba9-a487-1af160739738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfba0819-aa00-4980-88d8-9472aa65d557', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:19 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590 1073741824 Jul 14 13:04:19 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9d799d-be8c-4c45-a453-807c2be3e70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:19 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Volume volume-dfba0819-aa00-4980-88d8-9472aa65d557 (dfba0819-aa00-4980-88d8-9472aa65d557): created successfully Jul 14 13:04:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9d799d-be8c-4c45-a453-807c2be3e70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Flow 'volume_create_manager' (fb9ed040-a4e7-4595-87b9-6ef2d75a9add) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:04:19 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-0215af11-7ab7-43a7-a323-4851f9ba26eb tempest-VolumesGetTest-1140409626 None] Created volume successfully. Jul 14 13:04:19 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590 1073741824" returned: 0 in 0.521s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:19 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590 Jul 14 13:04:19 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:20 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590" returned: 0 in 0.354s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:04:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:20 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f99cf2-91b1-4136-ac40-a744344edc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a690ba23-b384-4278-b94a-00ab8cc3c590', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:20 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c55c48-f7df-4b14-b41c-a1b785451a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:20 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Volume volume-a690ba23-b384-4278-b94a-00ab8cc3c590 (a690ba23-b384-4278-b94a-00ab8cc3c590): created successfully Jul 14 13:04:20 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c55c48-f7df-4b14-b41c-a1b785451a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:20 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Flow 'volume_create_manager' (175a40b3-5ee1-4ecb-8e5b-afd9cd0446d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:04:20 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-ab085344-b58c-4065-8043-749a363b635a tempest-GroupSnapshotsV319Test-208110514 None] Created volume successfully. Jul 14 13:04:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2dbe42b5-f63c-4474-ba47-9504c045e3e4 tempest-VolumesGetTest-1140409626 None] Acquiring lock "cinder-dfba0819-aa00-4980-88d8-9472aa65d557-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2dbe42b5-f63c-4474-ba47-9504c045e3e4 tempest-VolumesGetTest-1140409626 None] Lock "cinder-dfba0819-aa00-4980-88d8-9472aa65d557-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2dbe42b5-f63c-4474-ba47-9504c045e3e4 tempest-VolumesGetTest-1140409626 None] Acquiring lock "cinder-quobyte-dfba0819-aa00-4980-88d8-9472aa65d557" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2dbe42b5-f63c-4474-ba47-9504c045e3e4 tempest-VolumesGetTest-1140409626 None] Lock "cinder-quobyte-dfba0819-aa00-4980-88d8-9472aa65d557" acquired by "delete_volume" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:20 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87d3f42-dd73-4c1a-9294-60f0d9f71810]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2dbe42b5-f63c-4474-ba47-9504c045e3e4 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfba0819-aa00-4980-88d8-9472aa65d557 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:20 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfba0819-aa00-4980-88d8-9472aa65d557 Jul 14 13:04:20 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:20 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2dbe42b5-f63c-4474-ba47-9504c045e3e4 tempest-VolumesGetTest-1140409626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfba0819-aa00-4980-88d8-9472aa65d557" returned: 0 in 0.402s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2dbe42b5-f63c-4474-ba47-9504c045e3e4 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfba0819-aa00-4980-88d8-9472aa65d557 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:20 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfba0819-aa00-4980-88d8-9472aa65d557 Jul 14 13:04:20 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:21 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2dbe42b5-f63c-4474-ba47-9504c045e3e4 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfba0819-aa00-4980-88d8-9472aa65d557" returned: 0 in 0.296s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2dbe42b5-f63c-4474-ba47-9504c045e3e4 tempest-VolumesGetTest-1140409626 None] Lock "cinder-quobyte-dfba0819-aa00-4980-88d8-9472aa65d557" released by "delete_volume" :: held 0.765s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-2dbe42b5-f63c-4474-ba47-9504c045e3e4 tempest-VolumesGetTest-1140409626 None] Created reservations ['f9dcf868-e3f0-4253-9d72-a944a29188e9', '797d9477-bdd3-44e2-a7a8-d8ba7208bc74', '160a9d91-bf55-455c-88d6-88cdad27b508', '2871f993-4f4e-4c0c-ae12-69ae45b9bc49'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2dbe42b5-f63c-4474-ba47-9504c045e3e4 tempest-VolumesGetTest-1140409626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2dbe42b5-f63c-4474-ba47-9504c045e3e4 tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2dbe42b5-f63c-4474-ba47-9504c045e3e4 tempest-VolumesGetTest-1140409626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2dbe42b5-f63c-4474-ba47-9504c045e3e4 tempest-VolumesGetTest-1140409626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2dbe42b5-f63c-4474-ba47-9504c045e3e4 tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2dbe42b5-f63c-4474-ba47-9504c045e3e4 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:21 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-bf480c07-964f-4a62-9618-c72faa9526a3 tempest-GroupSnapshotsV319Test-208110514 None] GroupSnapshot 7a930d44-5d63-4fdf-952d-55237e837baa: creating. Jul 14 13:04:21 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:04:21 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bf480c07-964f-4a62-9618-c72faa9526a3 tempest-GroupSnapshotsV319Test-208110514 None] Group snapshot 7a930d44-5d63-4fdf-952d-55237e837baa: creating. {{(pid=86977) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bf480c07-964f-4a62-9618-c72faa9526a3 tempest-GroupSnapshotsV319Test-208110514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bf480c07-964f-4a62-9618-c72faa9526a3 tempest-GroupSnapshotsV319Test-208110514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-bf480c07-964f-4a62-9618-c72faa9526a3 tempest-GroupSnapshotsV319Test-208110514 None] Creating offline snapshot 51aa5660-61ab-406e-bdde-02259d406d85 of volume a690ba23-b384-4278-b94a-00ab8cc3c590 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b83e1b-df0c-4f40-8861-6a700ff0d9aa]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bf480c07-964f-4a62-9618-c72faa9526a3 tempest-GroupSnapshotsV319Test-208110514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:21 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590 Jul 14 13:04:21 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f87a8cb9-07bc-440e-a6ee-d29c1c354c70 tempest-VolumesGetTest-1140409626 None] Acquiring lock "cinder-d5cb0018-c38d-441f-b20a-9cfecf22fa96-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:21 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2dbe42b5-f63c-4474-ba47-9504c045e3e4 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.347s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-2dbe42b5-f63c-4474-ba47-9504c045e3e4 tempest-VolumesGetTest-1140409626 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:04:21 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-2dbe42b5-f63c-4474-ba47-9504c045e3e4 tempest-VolumesGetTest-1140409626 None] Deleted volume successfully. Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f87a8cb9-07bc-440e-a6ee-d29c1c354c70 tempest-VolumesGetTest-1140409626 None] Lock "cinder-d5cb0018-c38d-441f-b20a-9cfecf22fa96-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2dbe42b5-f63c-4474-ba47-9504c045e3e4 tempest-VolumesGetTest-1140409626 None] Lock "cinder-dfba0819-aa00-4980-88d8-9472aa65d557-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f87a8cb9-07bc-440e-a6ee-d29c1c354c70 tempest-VolumesGetTest-1140409626 None] Acquiring lock "cinder-quobyte-d5cb0018-c38d-441f-b20a-9cfecf22fa96" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f87a8cb9-07bc-440e-a6ee-d29c1c354c70 tempest-VolumesGetTest-1140409626 None] Lock "cinder-quobyte-d5cb0018-c38d-441f-b20a-9cfecf22fa96" acquired by "delete_volume" :: waited 0.023s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f19a1b-34bc-4135-872c-27be5bef0721]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f87a8cb9-07bc-440e-a6ee-d29c1c354c70 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d5cb0018-c38d-441f-b20a-9cfecf22fa96 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:22 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d5cb0018-c38d-441f-b20a-9cfecf22fa96 Jul 14 13:04:22 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:22 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bf480c07-964f-4a62-9618-c72faa9526a3 tempest-GroupSnapshotsV319Test-208110514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590" returned: 0 in 0.542s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bf480c07-964f-4a62-9618-c72faa9526a3 tempest-GroupSnapshotsV319Test-208110514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.51aa5660-61ab-406e-bdde-02259d406d85 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:22 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.51aa5660-61ab-406e-bdde-02259d406d85 1G Jul 14 13:04:22 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:22 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f87a8cb9-07bc-440e-a6ee-d29c1c354c70 tempest-VolumesGetTest-1140409626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d5cb0018-c38d-441f-b20a-9cfecf22fa96" returned: 0 in 0.498s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f87a8cb9-07bc-440e-a6ee-d29c1c354c70 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d5cb0018-c38d-441f-b20a-9cfecf22fa96 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:22 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d5cb0018-c38d-441f-b20a-9cfecf22fa96 Jul 14 13:04:22 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:22 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bf480c07-964f-4a62-9618-c72faa9526a3 tempest-GroupSnapshotsV319Test-208110514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.51aa5660-61ab-406e-bdde-02259d406d85 1G" returned: 0 in 0.505s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bf480c07-964f-4a62-9618-c72faa9526a3 tempest-GroupSnapshotsV319Test-208110514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a690ba23-b384-4278-b94a-00ab8cc3c590 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.51aa5660-61ab-406e-bdde-02259d406d85 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:22 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a690ba23-b384-4278-b94a-00ab8cc3c590 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.51aa5660-61ab-406e-bdde-02259d406d85 Jul 14 13:04:22 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:22 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f87a8cb9-07bc-440e-a6ee-d29c1c354c70 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d5cb0018-c38d-441f-b20a-9cfecf22fa96" returned: 0 in 0.280s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f87a8cb9-07bc-440e-a6ee-d29c1c354c70 tempest-VolumesGetTest-1140409626 None] Lock "cinder-quobyte-d5cb0018-c38d-441f-b20a-9cfecf22fa96" released by "delete_volume" :: held 0.837s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:22 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-f87a8cb9-07bc-440e-a6ee-d29c1c354c70 tempest-VolumesGetTest-1140409626 None] Created reservations ['b412bd20-8b85-46ab-a9c5-a7e62196da94', 'adaef4f5-89a9-4616-8005-eebfc764c063', '4d360d2d-3313-4c0e-9142-12d473b55f5e', 'c792f294-8b53-451c-ac87-1e7da4bf30a2'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:04:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f87a8cb9-07bc-440e-a6ee-d29c1c354c70 tempest-VolumesGetTest-1140409626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f87a8cb9-07bc-440e-a6ee-d29c1c354c70 tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f87a8cb9-07bc-440e-a6ee-d29c1c354c70 tempest-VolumesGetTest-1140409626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f87a8cb9-07bc-440e-a6ee-d29c1c354c70 tempest-VolumesGetTest-1140409626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f87a8cb9-07bc-440e-a6ee-d29c1c354c70 tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f87a8cb9-07bc-440e-a6ee-d29c1c354c70 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:22 devstack sudo[97428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:04:23 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:23 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bf480c07-964f-4a62-9618-c72faa9526a3 tempest-GroupSnapshotsV319Test-208110514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a690ba23-b384-4278-b94a-00ab8cc3c590 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.51aa5660-61ab-406e-bdde-02259d406d85" returned: 0 in 0.400s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:23 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-bf480c07-964f-4a62-9618-c72faa9526a3 tempest-GroupSnapshotsV319Test-208110514 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.51aa5660-61ab-406e-bdde-02259d406d85 is being set with open permissions: ugo+rw: NotImplementedError Jul 14 13:04:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bf480c07-964f-4a62-9618-c72faa9526a3 tempest-GroupSnapshotsV319Test-208110514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.51aa5660-61ab-406e-bdde-02259d406d85 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:23 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.51aa5660-61ab-406e-bdde-02259d406d85 Jul 14 13:04:23 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-697c3eaa-0e59-4722-8345-6ba9310fd804 tempest-VolumesGetTest-1140409626 None] Acquiring lock "cinder-955f39ed-a3f5-4403-b770-94b31a97c066-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-697c3eaa-0e59-4722-8345-6ba9310fd804 tempest-VolumesGetTest-1140409626 None] Lock "cinder-955f39ed-a3f5-4403-b770-94b31a97c066-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-697c3eaa-0e59-4722-8345-6ba9310fd804 tempest-VolumesGetTest-1140409626 None] Acquiring lock "cinder-quobyte-955f39ed-a3f5-4403-b770-94b31a97c066" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:23 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f87a8cb9-07bc-440e-a6ee-d29c1c354c70 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.411s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:23 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-f87a8cb9-07bc-440e-a6ee-d29c1c354c70 tempest-VolumesGetTest-1140409626 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:04:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-697c3eaa-0e59-4722-8345-6ba9310fd804 tempest-VolumesGetTest-1140409626 None] Lock "cinder-quobyte-955f39ed-a3f5-4403-b770-94b31a97c066" acquired by "delete_volume" :: waited 0.034s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:23 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:23 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-f87a8cb9-07bc-440e-a6ee-d29c1c354c70 tempest-VolumesGetTest-1140409626 None] Deleted volume successfully. Jul 14 13:04:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bf480c07-964f-4a62-9618-c72faa9526a3 tempest-GroupSnapshotsV319Test-208110514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.51aa5660-61ab-406e-bdde-02259d406d85" returned: 0 in 0.362s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:23 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fa0d2f-9df1-40cc-9d3d-b8c54a01b33e]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-697c3eaa-0e59-4722-8345-6ba9310fd804 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bf480c07-964f-4a62-9618-c72faa9526a3 tempest-GroupSnapshotsV319Test-208110514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f87a8cb9-07bc-440e-a6ee-d29c1c354c70 tempest-VolumesGetTest-1140409626 None] Lock "cinder-d5cb0018-c38d-441f-b20a-9cfecf22fa96-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:23 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.info Jul 14 13:04:23 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:23 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066 Jul 14 13:04:23 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:23 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bf480c07-964f-4a62-9618-c72faa9526a3 tempest-GroupSnapshotsV319Test-208110514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.info" returned: 0 in 0.394s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:23 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-bf480c07-964f-4a62-9618-c72faa9526a3 tempest-GroupSnapshotsV319Test-208110514 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.info is being set with open permissions: ugo+rw: NotImplementedError Jul 14 13:04:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bf480c07-964f-4a62-9618-c72faa9526a3 tempest-GroupSnapshotsV319Test-208110514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:23 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.info Jul 14 13:04:23 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:23 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-697c3eaa-0e59-4722-8345-6ba9310fd804 tempest-VolumesGetTest-1140409626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066" returned: 0 in 0.498s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-697c3eaa-0e59-4722-8345-6ba9310fd804 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:23 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066 Jul 14 13:04:23 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:24 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bf480c07-964f-4a62-9618-c72faa9526a3 tempest-GroupSnapshotsV319Test-208110514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.info" returned: 0 in 0.334s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bf480c07-964f-4a62-9618-c72faa9526a3 tempest-GroupSnapshotsV319Test-208110514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.689s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:24 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-697c3eaa-0e59-4722-8345-6ba9310fd804 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-955f39ed-a3f5-4403-b770-94b31a97c066" returned: 0 in 0.302s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-697c3eaa-0e59-4722-8345-6ba9310fd804 tempest-VolumesGetTest-1140409626 None] Lock "cinder-quobyte-955f39ed-a3f5-4403-b770-94b31a97c066" released by "delete_volume" :: held 0.894s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:24 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-697c3eaa-0e59-4722-8345-6ba9310fd804 tempest-VolumesGetTest-1140409626 None] Created reservations ['5c0ba65f-d9bf-4326-adec-85b34b8219aa', '30bf9ada-caeb-413d-ba08-b08f088595e8', 'a2897e2d-afb8-4143-bbf4-db60f72b3e5a', '84c84662-a3b5-4816-ba5c-6e18ea483db9'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:04:24 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-bf480c07-964f-4a62-9618-c72faa9526a3 tempest-GroupSnapshotsV319Test-208110514 None] group_snapshot 7a930d44-5d63-4fdf-952d-55237e837baa: created successfully Jul 14 13:04:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-697c3eaa-0e59-4722-8345-6ba9310fd804 tempest-VolumesGetTest-1140409626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-697c3eaa-0e59-4722-8345-6ba9310fd804 tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-697c3eaa-0e59-4722-8345-6ba9310fd804 tempest-VolumesGetTest-1140409626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-697c3eaa-0e59-4722-8345-6ba9310fd804 tempest-VolumesGetTest-1140409626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-697c3eaa-0e59-4722-8345-6ba9310fd804 tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-697c3eaa-0e59-4722-8345-6ba9310fd804 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:24 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:04:24 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:24 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-697c3eaa-0e59-4722-8345-6ba9310fd804 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.285s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:24 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-697c3eaa-0e59-4722-8345-6ba9310fd804 tempest-VolumesGetTest-1140409626 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:04:24 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-697c3eaa-0e59-4722-8345-6ba9310fd804 tempest-VolumesGetTest-1140409626 None] Deleted volume successfully. Jul 14 13:04:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-697c3eaa-0e59-4722-8345-6ba9310fd804 tempest-VolumesGetTest-1140409626 None] Lock "cinder-955f39ed-a3f5-4403-b770-94b31a97c066-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:25 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:04:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Flow 'volume_create_manager' (edd5e446-e166-47e9-bd76-70bd055ef0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:04:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf5f497-7acc-48cf-8ecb-0283677575dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf5f497-7acc-48cf-8ecb-0283677575dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1956097429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7351525e771449c592e2b68b78b6b101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:04:25Z,use_quota=True,user_id='699562c26b874be9b7ce45a20d384408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a592860c-acdf-45de-bf57-0d7f95790063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a592860c-acdf-45de-bf57-0d7f95790063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4914ec73-0d3b-41de-84ef-43c01329227c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:25 devstack cinder-volume[86977]: DEBUG cinder.image.glance [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Creating Keystone auth plugin from conf {{(pid=86977) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 13:04:25 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] group_snapshot 7a930d44-5d63-4fdf-952d-55237e837baa: deleting Jul 14 13:04:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] group_snapshot 7a930d44-5d63-4fdf-952d-55237e837baa: deleting {{(pid=86977) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 14 13:04:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] Acquiring lock "cinder-quobyte-a690ba23-b384-4278-b94a-00ab8cc3c590" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] Lock "cinder-quobyte-a690ba23-b384-4278-b94a-00ab8cc3c590" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] Acquiring lock "cinder-quobyte-51aa5660-61ab-406e-bdde-02259d406d85" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] Lock "cinder-quobyte-51aa5660-61ab-406e-bdde-02259d406d85" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] Deleting offline snapshot 51aa5660-61ab-406e-bdde-02259d406d85 of volume a690ba23-b384-4278-b94a-00ab8cc3c590 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:04:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] snapshot_file for this snap is: volume-a690ba23-b384-4278-b94a-00ab8cc3c590.51aa5660-61ab-406e-bdde-02259d406d85 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:04:25 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a905a30-10cf-425d-b022-02616ab2a2de]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.51aa5660-61ab-406e-bdde-02259d406d85 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4914ec73-0d3b-41de-84ef-43c01329227c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a', 'volume_name': 'volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a', 'volume_size': 1, 'image_id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cc8c62448314c45912011edd3ae5374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'created_at': datetime.datetime(2026, 7, 14, 10, 49, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 10, 49, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33abf4a9-ef06-4448-a45c-b53dca509874/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:26 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.51aa5660-61ab-406e-bdde-02259d406d85 Jul 14 13:04:26 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b51d547-786a-4101-b95c-12f5ba3db346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:26 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:26 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b51d547-786a-4101-b95c-12f5ba3db346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:26 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a14529-817d-4249-9760-8251f1c663e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:26 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Volume bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a', 'volume_size': 1, 'image_id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cc8c62448314c45912011edd3ae5374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'created_at': datetime.datetime(2026, 7, 14, 10, 49, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 10, 49, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33abf4a9-ef06-4448-a45c-b53dca509874/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 14 13:04:26 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Trying to clone bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a from image 33abf4a9-ef06-4448-a45c-b53dca509874 at location (None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}]). {{(pid=86977) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 13:04:26 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.51aa5660-61ab-406e-bdde-02259d406d85" returned: 0 in 0.570s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:26 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a690ba23-b384-4278-b94a-00ab8cc3c590(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:04:26 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c4c6a9-475a-403c-bd0b-0d5c400586ed]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:26 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590 Jul 14 13:04:26 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:26 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_t0q2pgkqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:751}} Jul 14 13:04:26 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Image download 20.69 MB at 20.69 MB/s Jul 14 13:04:26 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32e75b0-e771-4a7c-91e4-86bdfc4d15a0]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_t0q2pgkqdevstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:26 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_t0q2pgkqdevstack@QuobyteHD Jul 14 13:04:26 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:26 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590" returned: 0 in 0.466s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.51aa5660-61ab-406e-bdde-02259d406d85 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:26 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.51aa5660-61ab-406e-bdde-02259d406d85 Jul 14 13:04:26 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:27 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_t0q2pgkqdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:27 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Temporary image 33abf4a9-ef06-4448-a45c-b53dca509874 is fetched for user 699562c26b874be9b7ce45a20d384408. {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:1450}} Jul 14 13:04:27 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebeada4-495c-4f77-8a7c-19edabe8549f]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_t0q2pgkqdevstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:27 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_t0q2pgkqdevstack@QuobyteHD Jul 14 13:04:27 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:27 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.51aa5660-61ab-406e-bdde-02259d406d85" returned: 0 in 0.458s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.51aa5660-61ab-406e-bdde-02259d406d85 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:27 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.51aa5660-61ab-406e-bdde-02259d406d85 Jul 14 13:04:27 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:27 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_t0q2pgkqdevstack@QuobyteHD" returned: 0 in 0.455s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1956097429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7351525e771449c592e2b68b78b6b101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:04:25Z,use_quota=True,user_id='699562c26b874be9b7ce45a20d384408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:04:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Creating volume bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:04:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:04:27 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:04:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:27 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a 1073741824 Jul 14 13:04:27 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:27 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590.51aa5660-61ab-406e-bdde-02259d406d85" returned: 0 in 0.386s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] Lock "cinder-quobyte-51aa5660-61ab-406e-bdde-02259d406d85" released by "_delete_snapshot" :: held 2.032s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] Lock "cinder-quobyte-a690ba23-b384-4278-b94a-00ab8cc3c590" released by "delete_snapshot" :: held 2.080s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:27 devstack cinder-volume[86977]: WARNING cinder.quota [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-45628890 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-45628890, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:04:27 devstack cinder-volume[86977]: WARNING cinder.quota [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-45628890 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-45628890, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:04:27 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] Created reservations ['8153a61c-415a-48f0-9a54-34299d18d70e', 'ef2b1893-a3d3-4b30-9f15-73ce3c4d15ed', 'de92a1b8-b008-4e8c-ae12-6fef9e4d29e6', '7b4df820-5cab-42c7-8e94-77fc4311fb13'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:04:28 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b6f0fcf1-32bd-4dd7-b3d7-65cf313590cd tempest-GroupSnapshotsV319Test-208110514 None] group_snapshot 7a930d44-5d63-4fdf-952d-55237e837baa: deleted successfully Jul 14 13:04:28 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a 1073741824" returned: 0 in 0.617s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:28 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a Jul 14 13:04:28 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:28 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a" returned: 0 in 0.307s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:04:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:28 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Attempting download of 33abf4a9-ef06-4448-a45c-b53dca509874 ((None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}])) to volume bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a. {{(pid=86977) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 13:04:28 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafc5ee8-bd8b-4fdb-9529-2d70af9054ff]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_a5jdrkux {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:28 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_a5jdrkux Jul 14 13:04:28 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:29 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_a5jdrkux" returned: 0 in 0.381s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_a5jdrkux {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:29 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_a5jdrkux Jul 14 13:04:29 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7c6471aa-dd1c-4cc5-9f41-6fc3b03ae2ac tempest-GroupSnapshotsV319Test-208110514 None] Acquiring lock "cinder-quobyte-a690ba23-b384-4278-b94a-00ab8cc3c590" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7c6471aa-dd1c-4cc5-9f41-6fc3b03ae2ac tempest-GroupSnapshotsV319Test-208110514 None] Lock "cinder-quobyte-a690ba23-b384-4278-b94a-00ab8cc3c590" acquired by "delete_volume" :: waited 0.028s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:29 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[0233139b-8ae4-4f3a-a76e-30490f1a8909]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7c6471aa-dd1c-4cc5-9f41-6fc3b03ae2ac tempest-GroupSnapshotsV319Test-208110514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:29 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_a5jdrkux" returned: 1 in 0.456s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_a5jdrkux' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:04:29 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce233ae-b09c-49b8-9a53-9594b1ffa845]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_t0q2pgkqdevstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:29 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590 Jul 14 13:04:29 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:29 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_t0q2pgkqdevstack@QuobyteHD Jul 14 13:04:29 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:29 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7c6471aa-dd1c-4cc5-9f41-6fc3b03ae2ac tempest-GroupSnapshotsV319Test-208110514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590" returned: 0 in 0.496s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7c6471aa-dd1c-4cc5-9f41-6fc3b03ae2ac tempest-GroupSnapshotsV319Test-208110514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:30 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590 Jul 14 13:04:30 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:30 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_t0q2pgkqdevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:30 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] 33abf4a9-ef06-4448-a45c-b53dca509874 was qcow2, converting to raw {{(pid=86977) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1139}} Jul 14 13:04:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_t0q2pgkqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:30 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_t0q2pgkqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a Jul 14 13:04:30 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:30 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7c6471aa-dd1c-4cc5-9f41-6fc3b03ae2ac tempest-GroupSnapshotsV319Test-208110514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a690ba23-b384-4278-b94a-00ab8cc3c590" returned: 0 in 0.330s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:30 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7c6471aa-dd1c-4cc5-9f41-6fc3b03ae2ac tempest-GroupSnapshotsV319Test-208110514 None] Lock "cinder-quobyte-a690ba23-b384-4278-b94a-00ab8cc3c590" released by "delete_volume" :: held 0.954s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:30 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-7c6471aa-dd1c-4cc5-9f41-6fc3b03ae2ac tempest-GroupSnapshotsV319Test-208110514 None] Created reservations ['1ba52362-8418-4d7b-8f58-25ced89f5e1a'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:04:30 devstack cinder-volume[86977]: WARNING cinder.quota [None req-7c6471aa-dd1c-4cc5-9f41-6fc3b03ae2ac tempest-GroupSnapshotsV319Test-208110514 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-45628890 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-45628890, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:04:30 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-7c6471aa-dd1c-4cc5-9f41-6fc3b03ae2ac tempest-GroupSnapshotsV319Test-208110514 None] Created reservations ['d4357b64-bf0b-40c9-85cc-4efef2454841', '522d01fc-5ced-427f-bbde-b6186973c370', '109ce3b8-7d69-4592-8719-305949aa2ea3', '591b11b1-6b2d-4174-8ae6-7a28af7c8aa2'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:04:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7c6471aa-dd1c-4cc5-9f41-6fc3b03ae2ac tempest-GroupSnapshotsV319Test-208110514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7c6471aa-dd1c-4cc5-9f41-6fc3b03ae2ac tempest-GroupSnapshotsV319Test-208110514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7c6471aa-dd1c-4cc5-9f41-6fc3b03ae2ac tempest-GroupSnapshotsV319Test-208110514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7c6471aa-dd1c-4cc5-9f41-6fc3b03ae2ac tempest-GroupSnapshotsV319Test-208110514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7c6471aa-dd1c-4cc5-9f41-6fc3b03ae2ac tempest-GroupSnapshotsV319Test-208110514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7c6471aa-dd1c-4cc5-9f41-6fc3b03ae2ac tempest-GroupSnapshotsV319Test-208110514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:30 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:04:30 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:31 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7c6471aa-dd1c-4cc5-9f41-6fc3b03ae2ac tempest-GroupSnapshotsV319Test-208110514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.337s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-7c6471aa-dd1c-4cc5-9f41-6fc3b03ae2ac tempest-GroupSnapshotsV319Test-208110514 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:04:31 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-7c6471aa-dd1c-4cc5-9f41-6fc3b03ae2ac tempest-GroupSnapshotsV319Test-208110514 None] Delete group completed successfully. Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Flow 'volume_create_manager' (6d5eaee1-ae25-47fb-bf3e-31e07708f1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4531acb0-f338-42fc-bb29-a554cbd44b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4531acb0-f338-42fc-bb29-a554cbd44b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1498786269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6977abbe-592b-4551-87bb-587b09b6f0d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02de2244cfd449adb0638eb16113cfff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:04:31Z,use_quota=True,user_id='25502d9ef3a346b3a42716bef64094d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79602478-af1b-4970-a484-a91ef648a77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79602478-af1b-4970-a484-a91ef648a77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae18324-bf12-426a-9903-b6ff39335b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae18324-bf12-426a-9903-b6ff39335b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6977abbe-592b-4551-87bb-587b09b6f0d6', 'volume_name': 'volume-6977abbe-592b-4551-87bb-587b09b6f0d6', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c983cf63-900f-4b4f-9576-c6214bc730a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c983cf63-900f-4b4f-9576-c6214bc730a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952e1dea-b2ea-4981-9be6-28d86c49a0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:31 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Volume 6977abbe-592b-4551-87bb-587b09b6f0d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6977abbe-592b-4551-87bb-587b09b6f0d6', 'volume_size': 1} Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1498786269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6977abbe-592b-4551-87bb-587b09b6f0d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02de2244cfd449adb0638eb16113cfff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:04:31Z,use_quota=True,user_id='25502d9ef3a346b3a42716bef64094d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Creating volume 6977abbe-592b-4551-87bb-587b09b6f0d6 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:04:31 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:04:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6977abbe-592b-4551-87bb-587b09b6f0d6 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:31 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6977abbe-592b-4551-87bb-587b09b6f0d6 1073741824 Jul 14 13:04:31 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:32 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_t0q2pgkqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a" returned: 0 in 1.999s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:32 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_t0q2pgkqdevstack@QuobyteHD, size 112.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:04:32 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Converted 112.00 MB image at 55.97 MB/s Jul 14 13:04:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:32 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a 1G Jul 14 13:04:32 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:32 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6977abbe-592b-4551-87bb-587b09b6f0d6 1073741824" returned: 0 in 0.646s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6977abbe-592b-4551-87bb-587b09b6f0d6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:32 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6977abbe-592b-4551-87bb-587b09b6f0d6 Jul 14 13:04:32 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:32 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a 1G" returned: 0 in 0.408s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:32 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[456d3092-a94f-4003-ac80-0045889f7906]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:32 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6977abbe-592b-4551-87bb-587b09b6f0d6" returned: 0 in 0.321s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:32 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:04:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952e1dea-b2ea-4981-9be6-28d86c49a0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6977abbe-592b-4551-87bb-587b09b6f0d6', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f5d9f9-db2e-42ec-8bd4-477d5be27659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:32 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Volume volume-6977abbe-592b-4551-87bb-587b09b6f0d6 (6977abbe-592b-4551-87bb-587b09b6f0d6): created successfully Jul 14 13:04:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f5d9f9-db2e-42ec-8bd4-477d5be27659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Flow 'volume_create_manager' (6d5eaee1-ae25-47fb-bf3e-31e07708f1e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:04:32 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-8fdb0c3f-8bd4-4af4-a0c8-b3d7dcfaa840 tempest-ProjectReaderTests-733832897 None] Created volume successfully. Jul 14 13:04:32 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a Jul 14 13:04:32 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:32 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a" returned: 0 in 0.454s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:33 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a Jul 14 13:04:33 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:33 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a" returned: 1 in 0.440s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:04:33 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Downloaded image 33abf4a9-ef06-4448-a45c-b53dca509874 ((None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}])) to volume bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a successfully. {{(pid=86977) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 13:04:33 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Temporary image 33abf4a9-ef06-4448-a45c-b53dca509874 for user 699562c26b874be9b7ce45a20d384408 is deleted. {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:1454}} Jul 14 13:04:33 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Marking volume bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a as bootable. {{(pid=86977) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 13:04:33 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Copying metadata from image 33abf4a9-ef06-4448-a45c-b53dca509874 to bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a. {{(pid=86977) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 13:04:33 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Creating volume glance metadata for volume bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a backed by image 33abf4a9-ef06-4448-a45c-b53dca509874 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86977) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 13:04:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a14529-817d-4249-9760-8251f1c663e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a', 'volume_size': 1, 'image_id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cc8c62448314c45912011edd3ae5374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'created_at': datetime.datetime(2026, 7, 14, 10, 49, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 10, 49, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33abf4a9-ef06-4448-a45c-b53dca509874/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e239357d-1b59-4f9e-bc65-6e5a273b2bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:33 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Volume volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a (bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a): created successfully Jul 14 13:04:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e239357d-1b59-4f9e-bc65-6e5a273b2bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Flow 'volume_create_manager' (edd5e446-e166-47e9-bd76-70bd055ef0f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:04:33 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-3c5f9c69-ac24-4461-abe1-bdb211eb9314 tempest-VolumesGetTest-1140409626 None] Created volume successfully. Jul 14 13:04:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a08f81b2-8df1-4331-a7ae-4be1f887433f tempest-ProjectReaderTests-733832897 None] Acquiring lock "cinder-6977abbe-592b-4551-87bb-587b09b6f0d6-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a08f81b2-8df1-4331-a7ae-4be1f887433f tempest-ProjectReaderTests-733832897 None] Lock "cinder-6977abbe-592b-4551-87bb-587b09b6f0d6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a08f81b2-8df1-4331-a7ae-4be1f887433f tempest-ProjectReaderTests-733832897 None] Acquiring lock "cinder-quobyte-6977abbe-592b-4551-87bb-587b09b6f0d6" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a08f81b2-8df1-4331-a7ae-4be1f887433f tempest-ProjectReaderTests-733832897 None] Lock "cinder-quobyte-6977abbe-592b-4551-87bb-587b09b6f0d6" acquired by "delete_volume" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:34 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6397849-f3f2-464d-af1f-d082e646bb09]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a08f81b2-8df1-4331-a7ae-4be1f887433f tempest-ProjectReaderTests-733832897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6977abbe-592b-4551-87bb-587b09b6f0d6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:34 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6977abbe-592b-4551-87bb-587b09b6f0d6 Jul 14 13:04:34 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:34 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a08f81b2-8df1-4331-a7ae-4be1f887433f tempest-ProjectReaderTests-733832897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6977abbe-592b-4551-87bb-587b09b6f0d6" returned: 0 in 0.500s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a08f81b2-8df1-4331-a7ae-4be1f887433f tempest-ProjectReaderTests-733832897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6977abbe-592b-4551-87bb-587b09b6f0d6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:34 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6977abbe-592b-4551-87bb-587b09b6f0d6 Jul 14 13:04:34 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:34 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a08f81b2-8df1-4331-a7ae-4be1f887433f tempest-ProjectReaderTests-733832897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6977abbe-592b-4551-87bb-587b09b6f0d6" returned: 0 in 0.327s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a08f81b2-8df1-4331-a7ae-4be1f887433f tempest-ProjectReaderTests-733832897 None] Lock "cinder-quobyte-6977abbe-592b-4551-87bb-587b09b6f0d6" released by "delete_volume" :: held 0.884s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:34 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-a08f81b2-8df1-4331-a7ae-4be1f887433f tempest-ProjectReaderTests-733832897 None] Created reservations ['1e0fb2d5-0b29-4b73-a474-546d21309e44', 'b00cc117-37b9-494b-b1ca-848d609c72fd', '31202ffb-b949-4efa-8e26-0921a233abdd', 'bbcea9c0-c25a-429c-a2c8-d7b5db82c74d'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a08f81b2-8df1-4331-a7ae-4be1f887433f tempest-ProjectReaderTests-733832897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a08f81b2-8df1-4331-a7ae-4be1f887433f tempest-ProjectReaderTests-733832897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a08f81b2-8df1-4331-a7ae-4be1f887433f tempest-ProjectReaderTests-733832897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a08f81b2-8df1-4331-a7ae-4be1f887433f tempest-ProjectReaderTests-733832897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a08f81b2-8df1-4331-a7ae-4be1f887433f tempest-ProjectReaderTests-733832897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a08f81b2-8df1-4331-a7ae-4be1f887433f tempest-ProjectReaderTests-733832897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:35 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:04:35 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Flow 'volume_create_manager' (4c1dac86-151f-4b79-9d7e-e0d90d4034cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264fd5e9-3bc5-4eeb-8096-c36c8691adef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264fd5e9-3bc5-4eeb-8096-c36c8691adef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:04:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-468600395',display_name='tempest-VolumesGetTest-Volume-1449293894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed5d577b-4508-4d6c-a966-b6095dead265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7351525e771449c592e2b68b78b6b101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:04:35Z,use_quota=True,user_id='699562c26b874be9b7ce45a20d384408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d57ab4c-81ee-4522-ac5c-23264327e955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d57ab4c-81ee-4522-ac5c-23264327e955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b5470d-608c-4f36-9234-aca663a9ac24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:35 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b5470d-608c-4f36-9234-aca663a9ac24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed5d577b-4508-4d6c-a966-b6095dead265', 'volume_name': 'volume-ed5d577b-4508-4d6c-a966-b6095dead265', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ee7705-7e74-4e8a-8238-c021a43ed191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ee7705-7e74-4e8a-8238-c021a43ed191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541a80df-fa19-4eb4-b389-4efa679a0fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:35 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Volume ed5d577b-4508-4d6c-a966-b6095dead265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed5d577b-4508-4d6c-a966-b6095dead265', 'volume_size': 1} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:04:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-468600395',display_name='tempest-VolumesGetTest-Volume-1449293894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed5d577b-4508-4d6c-a966-b6095dead265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7351525e771449c592e2b68b78b6b101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:04:35Z,use_quota=True,user_id='699562c26b874be9b7ce45a20d384408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Creating volume ed5d577b-4508-4d6c-a966-b6095dead265 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:04:35 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ed5d577b-4508-4d6c-a966-b6095dead265 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a08f81b2-8df1-4331-a7ae-4be1f887433f tempest-ProjectReaderTests-733832897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.332s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-a08f81b2-8df1-4331-a7ae-4be1f887433f tempest-ProjectReaderTests-733832897 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:04:35 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-a08f81b2-8df1-4331-a7ae-4be1f887433f tempest-ProjectReaderTests-733832897 None] Deleted volume successfully. Jul 14 13:04:35 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ed5d577b-4508-4d6c-a966-b6095dead265 1073741824 Jul 14 13:04:35 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a08f81b2-8df1-4331-a7ae-4be1f887433f tempest-ProjectReaderTests-733832897 None] Lock "cinder-6977abbe-592b-4551-87bb-587b09b6f0d6-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:35 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ed5d577b-4508-4d6c-a966-b6095dead265 1073741824" returned: 0 in 0.540s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ed5d577b-4508-4d6c-a966-b6095dead265 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:36 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ed5d577b-4508-4d6c-a966-b6095dead265 Jul 14 13:04:36 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:36 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ed5d577b-4508-4d6c-a966-b6095dead265" returned: 0 in 0.402s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541a80df-fa19-4eb4-b389-4efa679a0fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed5d577b-4508-4d6c-a966-b6095dead265', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b145650-cb89-4b6f-b8c2-68c1f27d34c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:36 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Volume volume-ed5d577b-4508-4d6c-a966-b6095dead265 (ed5d577b-4508-4d6c-a966-b6095dead265): created successfully Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b145650-cb89-4b6f-b8c2-68c1f27d34c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Flow 'volume_create_manager' (4c1dac86-151f-4b79-9d7e-e0d90d4034cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:04:36 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-75580dc7-f72c-40b9-a895-1583c8cbd7f7 tempest-VolumesGetTest-1140409626 None] Created volume successfully. Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Flow 'volume_create_manager' (0e7d751f-e05f-4270-acbb-9a60380a8fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a776213-efa4-4e22-9437-51cebec491d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a776213-efa4-4e22-9437-51cebec491d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-261244941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da161ab-0031-408f-9bb8-45e5c9237608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02de2244cfd449adb0638eb16113cfff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:04:37Z,use_quota=True,user_id='25502d9ef3a346b3a42716bef64094d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44407db4-7100-4a0b-a686-a2ee2b526100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44407db4-7100-4a0b-a686-a2ee2b526100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3108317f-15dc-4e2e-ab59-651b217e48dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3108317f-15dc-4e2e-ab59-651b217e48dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7da161ab-0031-408f-9bb8-45e5c9237608', 'volume_name': 'volume-7da161ab-0031-408f-9bb8-45e5c9237608', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff0a038-d46a-402f-b840-a593d16f138c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff0a038-d46a-402f-b840-a593d16f138c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2d58d6-cdcf-4a8b-803a-5121ece4cb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:36 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Volume 7da161ab-0031-408f-9bb8-45e5c9237608: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7da161ab-0031-408f-9bb8-45e5c9237608', 'volume_size': 1} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-261244941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da161ab-0031-408f-9bb8-45e5c9237608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02de2244cfd449adb0638eb16113cfff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:04:37Z,use_quota=True,user_id='25502d9ef3a346b3a42716bef64094d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Creating volume 7da161ab-0031-408f-9bb8-45e5c9237608 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:04:36 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:04:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7da161ab-0031-408f-9bb8-45e5c9237608 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:36 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7da161ab-0031-408f-9bb8-45e5c9237608 1073741824 Jul 14 13:04:36 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a21264e2-412f-42c0-8e81-2febc5ade208 tempest-VolumesGetTest-1140409626 None] Acquiring lock "cinder-ed5d577b-4508-4d6c-a966-b6095dead265-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:37 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a21264e2-412f-42c0-8e81-2febc5ade208 tempest-VolumesGetTest-1140409626 None] Lock "cinder-ed5d577b-4508-4d6c-a966-b6095dead265-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7da161ab-0031-408f-9bb8-45e5c9237608 1073741824" returned: 0 in 0.668s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a21264e2-412f-42c0-8e81-2febc5ade208 tempest-VolumesGetTest-1140409626 None] Acquiring lock "cinder-quobyte-ed5d577b-4508-4d6c-a966-b6095dead265" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7da161ab-0031-408f-9bb8-45e5c9237608 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a21264e2-412f-42c0-8e81-2febc5ade208 tempest-VolumesGetTest-1140409626 None] Lock "cinder-quobyte-ed5d577b-4508-4d6c-a966-b6095dead265" acquired by "delete_volume" :: waited 0.035s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:37 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7da161ab-0031-408f-9bb8-45e5c9237608 Jul 14 13:04:37 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:37 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f3073a-dada-4ccc-afa9-4c1503c3bd5a]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a21264e2-412f-42c0-8e81-2febc5ade208 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ed5d577b-4508-4d6c-a966-b6095dead265 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:37 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ed5d577b-4508-4d6c-a966-b6095dead265 Jul 14 13:04:37 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:37 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7da161ab-0031-408f-9bb8-45e5c9237608" returned: 0 in 0.301s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:04:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2d58d6-cdcf-4a8b-803a-5121ece4cb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7da161ab-0031-408f-9bb8-45e5c9237608', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd54933-be7a-4091-b263-9af714e0bd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:38 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Volume volume-7da161ab-0031-408f-9bb8-45e5c9237608 (7da161ab-0031-408f-9bb8-45e5c9237608): created successfully Jul 14 13:04:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd54933-be7a-4091-b263-9af714e0bd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Flow 'volume_create_manager' (0e7d751f-e05f-4270-acbb-9a60380a8fe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:04:38 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e247b7ae-0f09-4f73-9c40-8139a0f765ed tempest-ProjectReaderTests-733832897 None] Created volume successfully. Jul 14 13:04:38 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a21264e2-412f-42c0-8e81-2febc5ade208 tempest-VolumesGetTest-1140409626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ed5d577b-4508-4d6c-a966-b6095dead265" returned: 0 in 0.446s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a21264e2-412f-42c0-8e81-2febc5ade208 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ed5d577b-4508-4d6c-a966-b6095dead265 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:38 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ed5d577b-4508-4d6c-a966-b6095dead265 Jul 14 13:04:38 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:38 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a21264e2-412f-42c0-8e81-2febc5ade208 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ed5d577b-4508-4d6c-a966-b6095dead265" returned: 0 in 0.292s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a21264e2-412f-42c0-8e81-2febc5ade208 tempest-VolumesGetTest-1140409626 None] Lock "cinder-quobyte-ed5d577b-4508-4d6c-a966-b6095dead265" released by "delete_volume" :: held 0.802s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:38 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-a21264e2-412f-42c0-8e81-2febc5ade208 tempest-VolumesGetTest-1140409626 None] Created reservations ['c67f8e6c-78c9-442c-ab5f-04b155eea0e0', '320384b3-4213-4b0a-b689-d6f1be002214', '2d01291a-ee9c-4616-b1ea-7d4665ca448c', 'e799ca9c-0c49-46ef-9b5b-8cc069f20c98'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:04:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a21264e2-412f-42c0-8e81-2febc5ade208 tempest-VolumesGetTest-1140409626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a21264e2-412f-42c0-8e81-2febc5ade208 tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a21264e2-412f-42c0-8e81-2febc5ade208 tempest-VolumesGetTest-1140409626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a21264e2-412f-42c0-8e81-2febc5ade208 tempest-VolumesGetTest-1140409626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a21264e2-412f-42c0-8e81-2febc5ade208 tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a21264e2-412f-42c0-8e81-2febc5ade208 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:38 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:04:38 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] Acquiring lock "cinder-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] Lock "cinder-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] Acquiring lock "cinder-quobyte-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] Lock "cinder-quobyte-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a" acquired by "delete_volume" :: waited 0.033s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:39 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3a5a88-06c6-4b86-b6ff-9a06e671697a]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:39 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-49d96822-dc01-4f50-9f75-14af79866e7d tempest-ProjectReaderTests-733832897 None] Acquiring lock "cinder-7da161ab-0031-408f-9bb8-45e5c9237608-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a21264e2-412f-42c0-8e81-2febc5ade208 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.464s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:39 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-a21264e2-412f-42c0-8e81-2febc5ade208 tempest-VolumesGetTest-1140409626 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:04:39 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-a21264e2-412f-42c0-8e81-2febc5ade208 tempest-VolumesGetTest-1140409626 None] Deleted volume successfully. Jul 14 13:04:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-49d96822-dc01-4f50-9f75-14af79866e7d tempest-ProjectReaderTests-733832897 None] Lock "cinder-7da161ab-0031-408f-9bb8-45e5c9237608-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a21264e2-412f-42c0-8e81-2febc5ade208 tempest-VolumesGetTest-1140409626 None] Lock "cinder-ed5d577b-4508-4d6c-a966-b6095dead265-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:39 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a Jul 14 13:04:39 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-49d96822-dc01-4f50-9f75-14af79866e7d tempest-ProjectReaderTests-733832897 None] Acquiring lock "cinder-quobyte-7da161ab-0031-408f-9bb8-45e5c9237608" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-49d96822-dc01-4f50-9f75-14af79866e7d tempest-ProjectReaderTests-733832897 None] Lock "cinder-quobyte-7da161ab-0031-408f-9bb8-45e5c9237608" acquired by "delete_volume" :: waited 0.025s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:39 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6d3850-bb80-4c7f-aeed-8abb39e0968a]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-49d96822-dc01-4f50-9f75-14af79866e7d tempest-ProjectReaderTests-733832897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7da161ab-0031-408f-9bb8-45e5c9237608 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:39 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7da161ab-0031-408f-9bb8-45e5c9237608 Jul 14 13:04:39 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:39 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a" returned: 0 in 0.468s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:39 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a Jul 14 13:04:39 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:39 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-49d96822-dc01-4f50-9f75-14af79866e7d tempest-ProjectReaderTests-733832897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7da161ab-0031-408f-9bb8-45e5c9237608" returned: 0 in 0.468s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-49d96822-dc01-4f50-9f75-14af79866e7d tempest-ProjectReaderTests-733832897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7da161ab-0031-408f-9bb8-45e5c9237608 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:39 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7da161ab-0031-408f-9bb8-45e5c9237608 Jul 14 13:04:39 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:39 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a" returned: 1 in 0.452s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:04:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:40 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a Jul 14 13:04:40 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:40 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-49d96822-dc01-4f50-9f75-14af79866e7d tempest-ProjectReaderTests-733832897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7da161ab-0031-408f-9bb8-45e5c9237608" returned: 0 in 0.306s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:40 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-49d96822-dc01-4f50-9f75-14af79866e7d tempest-ProjectReaderTests-733832897 None] Lock "cinder-quobyte-7da161ab-0031-408f-9bb8-45e5c9237608" released by "delete_volume" :: held 0.827s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:40 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-49d96822-dc01-4f50-9f75-14af79866e7d tempest-ProjectReaderTests-733832897 None] Created reservations ['325d243e-71fe-4f16-811a-fff0a2aad9c2', 'f5a97d0f-636f-418c-bcf2-940d190b8f9c', '7a914944-092a-496a-b8f7-ff50cdef667f', '5ce496df-868b-4fbc-b674-2df4e7df3b10'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:04:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-49d96822-dc01-4f50-9f75-14af79866e7d tempest-ProjectReaderTests-733832897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-49d96822-dc01-4f50-9f75-14af79866e7d tempest-ProjectReaderTests-733832897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:40 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-49d96822-dc01-4f50-9f75-14af79866e7d tempest-ProjectReaderTests-733832897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:40 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-49d96822-dc01-4f50-9f75-14af79866e7d tempest-ProjectReaderTests-733832897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-49d96822-dc01-4f50-9f75-14af79866e7d tempest-ProjectReaderTests-733832897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-49d96822-dc01-4f50-9f75-14af79866e7d tempest-ProjectReaderTests-733832897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:40 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:04:40 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:40 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a" returned: 0 in 0.435s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:40 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] Lock "cinder-quobyte-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a" released by "delete_volume" :: held 1.458s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:40 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] Created reservations ['f43950c2-3907-4820-bb24-9b0d7495c9c5', 'b1ab91d8-3049-4159-9627-4af516aef6f7', 'd1ae1741-20ec-4f5e-8403-253d35c99307', '37d9ec74-6da8-4757-aba5-eedf673e9471'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:04:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:40 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:40 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:40 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:04:40 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:40 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-49d96822-dc01-4f50-9f75-14af79866e7d tempest-ProjectReaderTests-733832897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.535s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:40 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-49d96822-dc01-4f50-9f75-14af79866e7d tempest-ProjectReaderTests-733832897 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:04:40 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-49d96822-dc01-4f50-9f75-14af79866e7d tempest-ProjectReaderTests-733832897 None] Deleted volume successfully. Jul 14 13:04:40 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-49d96822-dc01-4f50-9f75-14af79866e7d tempest-ProjectReaderTests-733832897 None] Lock "cinder-7da161ab-0031-408f-9bb8-45e5c9237608-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:41 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.508s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:04:41 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] Deleted volume successfully. Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-04e628f6-051e-4f8b-8166-391a73e29192 tempest-VolumesGetTest-1140409626 None] Lock "cinder-bb6f5a78-6ca9-4a81-bce2-c66dc5801c1a-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Flow 'volume_create_manager' (3b984469-9c0e-43eb-b963-625c3d30b60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb78a30a-a6d9-4764-a7b1-6027c95b5463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb78a30a-a6d9-4764-a7b1-6027c95b5463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1444318839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a2d810-42f4-4d87-850f-3c82625cabbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02de2244cfd449adb0638eb16113cfff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:04:41Z,use_quota=True,user_id='25502d9ef3a346b3a42716bef64094d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8f53c7-502e-4df2-8948-d0e2bc9d1d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8f53c7-502e-4df2-8948-d0e2bc9d1d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d5b7f8-683d-4b32-a46b-843fd61d3d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d5b7f8-683d-4b32-a46b-843fd61d3d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10a2d810-42f4-4d87-850f-3c82625cabbf', 'volume_name': 'volume-10a2d810-42f4-4d87-850f-3c82625cabbf', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ba0e19-252b-4d3b-ac66-c592b25a513b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ba0e19-252b-4d3b-ac66-c592b25a513b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb20e53-b21a-45fe-8b75-67a9c2392846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:41 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Volume 10a2d810-42f4-4d87-850f-3c82625cabbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10a2d810-42f4-4d87-850f-3c82625cabbf', 'volume_size': 1} Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1444318839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a2d810-42f4-4d87-850f-3c82625cabbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02de2244cfd449adb0638eb16113cfff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:04:41Z,use_quota=True,user_id='25502d9ef3a346b3a42716bef64094d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Creating volume 10a2d810-42f4-4d87-850f-3c82625cabbf {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:04:41 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:04:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-10a2d810-42f4-4d87-850f-3c82625cabbf 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:41 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-10a2d810-42f4-4d87-850f-3c82625cabbf 1073741824 Jul 14 13:04:41 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:42 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-10a2d810-42f4-4d87-850f-3c82625cabbf 1073741824" returned: 0 in 0.646s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-10a2d810-42f4-4d87-850f-3c82625cabbf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:42 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-10a2d810-42f4-4d87-850f-3c82625cabbf Jul 14 13:04:42 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:42 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-10a2d810-42f4-4d87-850f-3c82625cabbf" returned: 0 in 0.416s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:42 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:04:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb20e53-b21a-45fe-8b75-67a9c2392846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10a2d810-42f4-4d87-850f-3c82625cabbf', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (226a5356-2cfb-4606-b9ce-0331f8c6786d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:42 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Volume volume-10a2d810-42f4-4d87-850f-3c82625cabbf (10a2d810-42f4-4d87-850f-3c82625cabbf): created successfully Jul 14 13:04:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (226a5356-2cfb-4606-b9ce-0331f8c6786d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Flow 'volume_create_manager' (3b984469-9c0e-43eb-b963-625c3d30b60e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:04:42 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-de1a2fd1-562e-4382-acef-d397893ed91e tempest-ProjectReaderTests-733832897 None] Created volume successfully. Jul 14 13:04:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-24680fdb-1673-4663-b3c1-56d7c39b7af0 tempest-ProjectReaderTests-733832897 None] Acquiring lock "cinder-10a2d810-42f4-4d87-850f-3c82625cabbf-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-24680fdb-1673-4663-b3c1-56d7c39b7af0 tempest-ProjectReaderTests-733832897 None] Lock "cinder-10a2d810-42f4-4d87-850f-3c82625cabbf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-24680fdb-1673-4663-b3c1-56d7c39b7af0 tempest-ProjectReaderTests-733832897 None] Acquiring lock "cinder-quobyte-10a2d810-42f4-4d87-850f-3c82625cabbf" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-24680fdb-1673-4663-b3c1-56d7c39b7af0 tempest-ProjectReaderTests-733832897 None] Lock "cinder-quobyte-10a2d810-42f4-4d87-850f-3c82625cabbf" acquired by "delete_volume" :: waited 0.043s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:43 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0f5589-8fa3-4862-b100-90fc2f55f0bb]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-24680fdb-1673-4663-b3c1-56d7c39b7af0 tempest-ProjectReaderTests-733832897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-10a2d810-42f4-4d87-850f-3c82625cabbf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:43 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-10a2d810-42f4-4d87-850f-3c82625cabbf Jul 14 13:04:43 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:44 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-24680fdb-1673-4663-b3c1-56d7c39b7af0 tempest-ProjectReaderTests-733832897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-10a2d810-42f4-4d87-850f-3c82625cabbf" returned: 0 in 0.483s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-24680fdb-1673-4663-b3c1-56d7c39b7af0 tempest-ProjectReaderTests-733832897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-10a2d810-42f4-4d87-850f-3c82625cabbf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:44 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-10a2d810-42f4-4d87-850f-3c82625cabbf Jul 14 13:04:44 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:44 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-24680fdb-1673-4663-b3c1-56d7c39b7af0 tempest-ProjectReaderTests-733832897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-10a2d810-42f4-4d87-850f-3c82625cabbf" returned: 0 in 0.356s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:44 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-24680fdb-1673-4663-b3c1-56d7c39b7af0 tempest-ProjectReaderTests-733832897 None] Lock "cinder-quobyte-10a2d810-42f4-4d87-850f-3c82625cabbf" released by "delete_volume" :: held 0.898s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:44 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-24680fdb-1673-4663-b3c1-56d7c39b7af0 tempest-ProjectReaderTests-733832897 None] Created reservations ['91e9c33c-0bbe-4c5e-a33a-e572c06ef416', 'e68b02ec-7237-4e85-ab1f-59bd8e84e7c4', 'de10dd12-f7ea-4d90-aa75-6f98b5a72745', '0e5d1ad1-b51f-4f4e-9128-822bff2db2c7'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:04:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-24680fdb-1673-4663-b3c1-56d7c39b7af0 tempest-ProjectReaderTests-733832897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-24680fdb-1673-4663-b3c1-56d7c39b7af0 tempest-ProjectReaderTests-733832897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:44 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-24680fdb-1673-4663-b3c1-56d7c39b7af0 tempest-ProjectReaderTests-733832897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:44 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-24680fdb-1673-4663-b3c1-56d7c39b7af0 tempest-ProjectReaderTests-733832897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-24680fdb-1673-4663-b3c1-56d7c39b7af0 tempest-ProjectReaderTests-733832897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-24680fdb-1673-4663-b3c1-56d7c39b7af0 tempest-ProjectReaderTests-733832897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:44 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:04:44 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:45 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-24680fdb-1673-4663-b3c1-56d7c39b7af0 tempest-ProjectReaderTests-733832897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.385s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-24680fdb-1673-4663-b3c1-56d7c39b7af0 tempest-ProjectReaderTests-733832897 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:04:45 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-24680fdb-1673-4663-b3c1-56d7c39b7af0 tempest-ProjectReaderTests-733832897 None] Deleted volume successfully. Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-24680fdb-1673-4663-b3c1-56d7c39b7af0 tempest-ProjectReaderTests-733832897 None] Lock "cinder-10a2d810-42f4-4d87-850f-3c82625cabbf-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Flow 'volume_create_manager' (7d570e4d-af83-4d55-9350-3c89a25f6e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1dbbe17-18a8-47b8-9ee2-1a6bc2f9bf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1dbbe17-18a8-47b8-9ee2-1a6bc2f9bf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1156572930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b7777ee-08df-4ff5-969c-1f70461ab482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02de2244cfd449adb0638eb16113cfff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:04:45Z,use_quota=True,user_id='25502d9ef3a346b3a42716bef64094d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9873d650-9d4f-4471-9624-4abe481e9bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9873d650-9d4f-4471-9624-4abe481e9bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6eb0411-8bcf-4ba2-9630-306801319563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6eb0411-8bcf-4ba2-9630-306801319563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b7777ee-08df-4ff5-969c-1f70461ab482', 'volume_name': 'volume-5b7777ee-08df-4ff5-969c-1f70461ab482', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d9edbf-cd0d-4629-8e6f-b650e62589da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d9edbf-cd0d-4629-8e6f-b650e62589da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (225a5a2b-2814-494c-9b69-abf3e034b1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:45 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Volume 5b7777ee-08df-4ff5-969c-1f70461ab482: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b7777ee-08df-4ff5-969c-1f70461ab482', 'volume_size': 1} Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1156572930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b7777ee-08df-4ff5-969c-1f70461ab482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02de2244cfd449adb0638eb16113cfff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:04:45Z,use_quota=True,user_id='25502d9ef3a346b3a42716bef64094d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Creating volume 5b7777ee-08df-4ff5-969c-1f70461ab482 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:04:45 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:04:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5b7777ee-08df-4ff5-969c-1f70461ab482 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:45 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5b7777ee-08df-4ff5-969c-1f70461ab482 1073741824 Jul 14 13:04:45 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:46 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5b7777ee-08df-4ff5-969c-1f70461ab482 1073741824" returned: 0 in 0.611s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5b7777ee-08df-4ff5-969c-1f70461ab482 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:46 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5b7777ee-08df-4ff5-969c-1f70461ab482 Jul 14 13:04:46 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:46 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5b7777ee-08df-4ff5-969c-1f70461ab482" returned: 0 in 0.460s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:46 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:04:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:46 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (225a5a2b-2814-494c-9b69-abf3e034b1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b7777ee-08df-4ff5-969c-1f70461ab482', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:46 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35291f73-6613-47f9-8ce5-41f1b9ebe2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:04:46 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Volume volume-5b7777ee-08df-4ff5-969c-1f70461ab482 (5b7777ee-08df-4ff5-969c-1f70461ab482): created successfully Jul 14 13:04:46 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35291f73-6613-47f9-8ce5-41f1b9ebe2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:04:46 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Flow 'volume_create_manager' (7d570e4d-af83-4d55-9350-3c89a25f6e26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:04:46 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-4fb75b99-7157-4c39-a514-26bda59e840b tempest-ProjectReaderTests-733832897 None] Created volume successfully. Jul 14 13:04:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0b135c1d-7726-4b2e-9ea9-20a912d5b6fc tempest-ProjectReaderTests-733832897 None] Acquiring lock "cinder-5b7777ee-08df-4ff5-969c-1f70461ab482-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0b135c1d-7726-4b2e-9ea9-20a912d5b6fc tempest-ProjectReaderTests-733832897 None] Lock "cinder-5b7777ee-08df-4ff5-969c-1f70461ab482-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0b135c1d-7726-4b2e-9ea9-20a912d5b6fc tempest-ProjectReaderTests-733832897 None] Acquiring lock "cinder-quobyte-5b7777ee-08df-4ff5-969c-1f70461ab482" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:04:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0b135c1d-7726-4b2e-9ea9-20a912d5b6fc tempest-ProjectReaderTests-733832897 None] Lock "cinder-quobyte-5b7777ee-08df-4ff5-969c-1f70461ab482" acquired by "delete_volume" :: waited 0.024s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:04:47 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[280a25dc-a2d8-4287-ac4e-17ccd09e2b73]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:04:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0b135c1d-7726-4b2e-9ea9-20a912d5b6fc tempest-ProjectReaderTests-733832897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5b7777ee-08df-4ff5-969c-1f70461ab482 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:47 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5b7777ee-08df-4ff5-969c-1f70461ab482 Jul 14 13:04:47 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:47 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0b135c1d-7726-4b2e-9ea9-20a912d5b6fc tempest-ProjectReaderTests-733832897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5b7777ee-08df-4ff5-969c-1f70461ab482" returned: 0 in 0.412s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0b135c1d-7726-4b2e-9ea9-20a912d5b6fc tempest-ProjectReaderTests-733832897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5b7777ee-08df-4ff5-969c-1f70461ab482 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:48 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5b7777ee-08df-4ff5-969c-1f70461ab482 Jul 14 13:04:48 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:48 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0b135c1d-7726-4b2e-9ea9-20a912d5b6fc tempest-ProjectReaderTests-733832897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5b7777ee-08df-4ff5-969c-1f70461ab482" returned: 0 in 0.355s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:48 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0b135c1d-7726-4b2e-9ea9-20a912d5b6fc tempest-ProjectReaderTests-733832897 None] Lock "cinder-quobyte-5b7777ee-08df-4ff5-969c-1f70461ab482" released by "delete_volume" :: held 0.832s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:48 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-0b135c1d-7726-4b2e-9ea9-20a912d5b6fc tempest-ProjectReaderTests-733832897 None] Created reservations ['8765edaa-5b80-4a68-ade8-88336b5071b0', '4519d162-6dd7-4505-b8af-b4adfa440ea0', '829c9567-3ed0-4b6e-a479-d7ac16877863', 'fbf98b35-0b6c-4234-8514-30c0a785de2c'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:04:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0b135c1d-7726-4b2e-9ea9-20a912d5b6fc tempest-ProjectReaderTests-733832897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:04:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0b135c1d-7726-4b2e-9ea9-20a912d5b6fc tempest-ProjectReaderTests-733832897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:04:48 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0b135c1d-7726-4b2e-9ea9-20a912d5b6fc tempest-ProjectReaderTests-733832897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:04:48 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0b135c1d-7726-4b2e-9ea9-20a912d5b6fc tempest-ProjectReaderTests-733832897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:04:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0b135c1d-7726-4b2e-9ea9-20a912d5b6fc tempest-ProjectReaderTests-733832897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:04:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0b135c1d-7726-4b2e-9ea9-20a912d5b6fc tempest-ProjectReaderTests-733832897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:04:48 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:04:48 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:04:48 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Jul 14 13:04:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0b135c1d-7726-4b2e-9ea9-20a912d5b6fc tempest-ProjectReaderTests-733832897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.312s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:04:48 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-0b135c1d-7726-4b2e-9ea9-20a912d5b6fc tempest-ProjectReaderTests-733832897 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:04:48 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-0b135c1d-7726-4b2e-9ea9-20a912d5b6fc tempest-ProjectReaderTests-733832897 None] Deleted volume successfully. Jul 14 13:04:48 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0b135c1d-7726-4b2e-9ea9-20a912d5b6fc tempest-ProjectReaderTests-733832897 None] Lock "cinder-5b7777ee-08df-4ff5-969c-1f70461ab482-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:04:58 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:UPDATE=207,cinder:SELECT=138,cinder:INSERT=50,cinder:DELETE=9 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:04:58 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=151,cinder:INSERT=59,cinder:UPDATE=197,cinder:DELETE=21 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Flow 'volume_create_manager' (8840e804-4914-4866-b453-9fbe84ecf130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3135a75b-54ff-4067-8536-4807e01f3441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3135a75b-54ff-4067-8536-4807e01f3441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-989184742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76fd8180-6000-410f-807f-9c45097667f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629b7355b5d64d0aa640698a15c46184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:06Z,use_quota=True,user_id='565997e01eb24bd792a1b12c9fc12917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c7977de-7c1e-4def-bdc9-f357ae49b574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c7977de-7c1e-4def-bdc9-f357ae49b574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23794f0e-0a1d-4433-9f50-65f6769853c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23794f0e-0a1d-4433-9f50-65f6769853c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76fd8180-6000-410f-807f-9c45097667f9', 'volume_name': 'volume-76fd8180-6000-410f-807f-9c45097667f9', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d1bbbe-ca0f-4b9b-b56f-ad9afe794261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d1bbbe-ca0f-4b9b-b56f-ad9afe794261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8ecb09-bc13-42aa-ab35-dd07cfba2026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:05 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Volume 76fd8180-6000-410f-807f-9c45097667f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76fd8180-6000-410f-807f-9c45097667f9', 'volume_size': 1} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-989184742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76fd8180-6000-410f-807f-9c45097667f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629b7355b5d64d0aa640698a15c46184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:06Z,use_quota=True,user_id='565997e01eb24bd792a1b12c9fc12917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Creating volume 76fd8180-6000-410f-807f-9c45097667f9 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:05:05 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-76fd8180-6000-410f-807f-9c45097667f9 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:05:05 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-76fd8180-6000-410f-807f-9c45097667f9 1073741824 Jul 14 13:05:05 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Flow 'volume_create_manager' (153a6409-2dfd-46fa-8d83-8c6a923e0a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8a7ab6-6b96-4145-975d-4722975d9d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8a7ab6-6b96-4145-975d-4722975d9d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1310952784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd06ed3-6d6f-489d-b2c9-79c7af406f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9138d66b3a484402a3ea3143fec385f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:06Z,use_quota=True,user_id='5fa471e8565b451099f983b67e6bc6c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7139ac6-66ac-4899-9cca-792a23162b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7139ac6-66ac-4899-9cca-792a23162b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d64d5a-8b62-4391-8ee0-0775a9f23d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d64d5a-8b62-4391-8ee0-0775a9f23d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd06ed3-6d6f-489d-b2c9-79c7af406f90', 'volume_name': 'volume-7cd06ed3-6d6f-489d-b2c9-79c7af406f90', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a13c844f-41a3-4b66-8e5d-127a33a2fa3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a13c844f-41a3-4b66-8e5d-127a33a2fa3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec4c196-3153-4558-accc-1946a594e6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:05 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Volume 7cd06ed3-6d6f-489d-b2c9-79c7af406f90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd06ed3-6d6f-489d-b2c9-79c7af406f90', 'volume_size': 1} Jul 14 13:05:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:06 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-76fd8180-6000-410f-807f-9c45097667f9 1073741824" returned: 0 in 0.592s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-76fd8180-6000-410f-807f-9c45097667f9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:06 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-76fd8180-6000-410f-807f-9c45097667f9 Jul 14 13:05:06 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:06 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-76fd8180-6000-410f-807f-9c45097667f9" returned: 0 in 0.266s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:05:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.766s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1310952784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd06ed3-6d6f-489d-b2c9-79c7af406f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9138d66b3a484402a3ea3143fec385f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:06Z,use_quota=True,user_id='5fa471e8565b451099f983b67e6bc6c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:05:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Creating volume 7cd06ed3-6d6f-489d-b2c9-79c7af406f90 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:05:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:05:06 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:05:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7cd06ed3-6d6f-489d-b2c9-79c7af406f90 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8ecb09-bc13-42aa-ab35-dd07cfba2026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76fd8180-6000-410f-807f-9c45097667f9', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:06 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7cd06ed3-6d6f-489d-b2c9-79c7af406f90 1073741824 Jul 14 13:05:06 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88bebffa-1f1a-4add-bdf2-393398b9084e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:06 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Volume volume-76fd8180-6000-410f-807f-9c45097667f9 (76fd8180-6000-410f-807f-9c45097667f9): created successfully Jul 14 13:05:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88bebffa-1f1a-4add-bdf2-393398b9084e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Flow 'volume_create_manager' (8840e804-4914-4866-b453-9fbe84ecf130) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:06 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-382237f5-a3c8-4b22-819c-1e36bd2f93aa tempest-VolumesActionsTest-1043955423 None] Created volume successfully. Jul 14 13:05:07 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7cd06ed3-6d6f-489d-b2c9-79c7af406f90 1073741824" returned: 0 in 0.502s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7cd06ed3-6d6f-489d-b2c9-79c7af406f90 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:07 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7cd06ed3-6d6f-489d-b2c9-79c7af406f90 Jul 14 13:05:07 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-67ecab8d-d2ad-45cd-9950-a09e0e809ca5 tempest-VolumesActionsTest-1043955423 None] Acquiring lock "cinder-76fd8180-6000-410f-807f-9c45097667f9" by "attach_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-67ecab8d-d2ad-45cd-9950-a09e0e809ca5 tempest-VolumesActionsTest-1043955423 None] Lock "cinder-76fd8180-6000-410f-807f-9c45097667f9" acquired by "attach_volume" :: waited 0.036s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:07 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7cd06ed3-6d6f-489d-b2c9-79c7af406f90" returned: 0 in 0.397s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:07 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:05:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:07 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec4c196-3153-4558-accc-1946a594e6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd06ed3-6d6f-489d-b2c9-79c7af406f90', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:07 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfacfad0-4337-4856-8555-8de374298142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:07 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Volume volume-7cd06ed3-6d6f-489d-b2c9-79c7af406f90 (7cd06ed3-6d6f-489d-b2c9-79c7af406f90): created successfully Jul 14 13:05:07 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfacfad0-4337-4856-8555-8de374298142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:07 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Flow 'volume_create_manager' (153a6409-2dfd-46fa-8d83-8c6a923e0a26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:07 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-d34a77a9-0e1f-461e-8db7-4b06cb2751a9 tempest-VolumesListAdminTestJSON-1030655228 None] Created volume successfully. Jul 14 13:05:07 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-67ecab8d-d2ad-45cd-9950-a09e0e809ca5 tempest-VolumesActionsTest-1043955423 None] Attaching volume 76fd8180-6000-410f-807f-9c45097667f9 to instance f51b320c-e93a-406a-afcb-aa91b25f26be at mountpoint /dev/vdb on host None. Jul 14 13:05:07 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-67ecab8d-d2ad-45cd-9950-a09e0e809ca5 tempest-VolumesActionsTest-1043955423 None] Attach volume completed successfully. Jul 14 13:05:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-67ecab8d-d2ad-45cd-9950-a09e0e809ca5 tempest-VolumesActionsTest-1043955423 None] Lock "cinder-76fd8180-6000-410f-807f-9c45097667f9" released by "attach_volume" :: held 0.151s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:08 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-7ea640e7-6996-4b1f-8173-e57dd0b0e016 tempest-VolumesActionsTest-1708452664 None] Terminate volume connection completed successfully. Jul 14 13:05:08 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7ea640e7-6996-4b1f-8173-e57dd0b0e016 tempest-VolumesActionsTest-1708452664 None] Acquiring lock "cinder-76fd8180-6000-410f-807f-9c45097667f9-detach_volume" by "detach_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:08 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7ea640e7-6996-4b1f-8173-e57dd0b0e016 tempest-VolumesActionsTest-1708452664 None] Lock "cinder-76fd8180-6000-410f-807f-9c45097667f9-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:08 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-7ea640e7-6996-4b1f-8173-e57dd0b0e016 tempest-VolumesActionsTest-1708452664 None] Detaching volume 76fd8180-6000-410f-807f-9c45097667f9 from instance f51b320c-e93a-406a-afcb-aa91b25f26be. Jul 14 13:05:08 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-7ea640e7-6996-4b1f-8173-e57dd0b0e016 tempest-VolumesActionsTest-1708452664 None] Detach volume completed successfully. Jul 14 13:05:08 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7ea640e7-6996-4b1f-8173-e57dd0b0e016 tempest-VolumesActionsTest-1708452664 None] Lock "cinder-76fd8180-6000-410f-807f-9c45097667f9-detach_volume" released by "detach_volume" :: held 0.073s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:08 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-24848c5a-5277-4462-9752-89ea15efdb14 tempest-VolumesActionsTest-1043955423 None] Acquiring lock "cinder-76fd8180-6000-410f-807f-9c45097667f9-detach_volume" by "detach_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:08 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-24848c5a-5277-4462-9752-89ea15efdb14 tempest-VolumesActionsTest-1043955423 None] Lock "cinder-76fd8180-6000-410f-807f-9c45097667f9-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:08 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-24848c5a-5277-4462-9752-89ea15efdb14 tempest-VolumesActionsTest-1043955423 None] Volume detach called, but volume not attached. Jul 14 13:05:08 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-24848c5a-5277-4462-9752-89ea15efdb14 tempest-VolumesActionsTest-1043955423 None] Lock "cinder-76fd8180-6000-410f-807f-9c45097667f9-detach_volume" released by "detach_volume" :: held 0.109s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1c2b6927-9b53-4eb3-a310-7ce63234d4dd tempest-VolumesActionsTest-1043955423 None] Acquiring lock "cinder-76fd8180-6000-410f-807f-9c45097667f9-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1c2b6927-9b53-4eb3-a310-7ce63234d4dd tempest-VolumesActionsTest-1043955423 None] Lock "cinder-76fd8180-6000-410f-807f-9c45097667f9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1c2b6927-9b53-4eb3-a310-7ce63234d4dd tempest-VolumesActionsTest-1043955423 None] Acquiring lock "cinder-quobyte-76fd8180-6000-410f-807f-9c45097667f9" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1c2b6927-9b53-4eb3-a310-7ce63234d4dd tempest-VolumesActionsTest-1043955423 None] Lock "cinder-quobyte-76fd8180-6000-410f-807f-9c45097667f9" acquired by "delete_volume" :: waited 0.029s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:09 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[992020e6-30cb-491d-92d6-0149d4454f76]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:05:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1c2b6927-9b53-4eb3-a310-7ce63234d4dd tempest-VolumesActionsTest-1043955423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-76fd8180-6000-410f-807f-9c45097667f9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:09 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-76fd8180-6000-410f-807f-9c45097667f9 Jul 14 13:05:09 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:09 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:05:09 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Flow 'volume_create_manager' (14a9d3fe-0855-4302-aad4-69aecf34132b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece6636f-8ce0-4465-b539-ea19cc138999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1c2b6927-9b53-4eb3-a310-7ce63234d4dd tempest-VolumesActionsTest-1043955423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-76fd8180-6000-410f-807f-9c45097667f9" returned: 0 in 0.510s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1c2b6927-9b53-4eb3-a310-7ce63234d4dd tempest-VolumesActionsTest-1043955423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-76fd8180-6000-410f-807f-9c45097667f9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece6636f-8ce0-4465-b539-ea19cc138999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-450153151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049738d5-2c88-4aa5-9dda-82e3f0e56395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9138d66b3a484402a3ea3143fec385f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:10Z,use_quota=True,user_id='5fa471e8565b451099f983b67e6bc6c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff7d33f-bb08-4e5d-bcb9-951d830bd0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:09 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-76fd8180-6000-410f-807f-9c45097667f9 Jul 14 13:05:09 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff7d33f-bb08-4e5d-bcb9-951d830bd0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ed36ae-9d19-43dc-975a-b3a0937cb033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ed36ae-9d19-43dc-975a-b3a0937cb033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '049738d5-2c88-4aa5-9dda-82e3f0e56395', 'volume_name': 'volume-049738d5-2c88-4aa5-9dda-82e3f0e56395', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67fc5b6c-43fe-4b0e-b15b-5177a7fd698c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67fc5b6c-43fe-4b0e-b15b-5177a7fd698c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0e35b0-86fc-4693-a7da-b843eced0721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:10 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Volume 049738d5-2c88-4aa5-9dda-82e3f0e56395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-049738d5-2c88-4aa5-9dda-82e3f0e56395', 'volume_size': 1} Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-450153151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049738d5-2c88-4aa5-9dda-82e3f0e56395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9138d66b3a484402a3ea3143fec385f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:10Z,use_quota=True,user_id='5fa471e8565b451099f983b67e6bc6c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Creating volume 049738d5-2c88-4aa5-9dda-82e3f0e56395 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:05:10 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-049738d5-2c88-4aa5-9dda-82e3f0e56395 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:10 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-049738d5-2c88-4aa5-9dda-82e3f0e56395 1073741824 Jul 14 13:05:10 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:10 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1c2b6927-9b53-4eb3-a310-7ce63234d4dd tempest-VolumesActionsTest-1043955423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-76fd8180-6000-410f-807f-9c45097667f9" returned: 0 in 0.389s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1c2b6927-9b53-4eb3-a310-7ce63234d4dd tempest-VolumesActionsTest-1043955423 None] Lock "cinder-quobyte-76fd8180-6000-410f-807f-9c45097667f9" released by "delete_volume" :: held 0.988s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-1c2b6927-9b53-4eb3-a310-7ce63234d4dd tempest-VolumesActionsTest-1043955423 None] Created reservations ['505abcf7-f843-4c45-a90d-79e878c13766', '6bc4bbfc-99fd-4923-8497-fcc7ff8016af', '328f66ec-39d9-4931-b2a9-b41be550fb7a', 'efb76367-726b-4cbc-ab8e-74b5f34984ea'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1c2b6927-9b53-4eb3-a310-7ce63234d4dd tempest-VolumesActionsTest-1043955423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1c2b6927-9b53-4eb3-a310-7ce63234d4dd tempest-VolumesActionsTest-1043955423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1c2b6927-9b53-4eb3-a310-7ce63234d4dd tempest-VolumesActionsTest-1043955423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1c2b6927-9b53-4eb3-a310-7ce63234d4dd tempest-VolumesActionsTest-1043955423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1c2b6927-9b53-4eb3-a310-7ce63234d4dd tempest-VolumesActionsTest-1043955423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1c2b6927-9b53-4eb3-a310-7ce63234d4dd tempest-VolumesActionsTest-1043955423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:10 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:05:10 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:10 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-049738d5-2c88-4aa5-9dda-82e3f0e56395 1073741824" returned: 0 in 0.866s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-049738d5-2c88-4aa5-9dda-82e3f0e56395 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:10 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-049738d5-2c88-4aa5-9dda-82e3f0e56395 Jul 14 13:05:10 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1c2b6927-9b53-4eb3-a310-7ce63234d4dd tempest-VolumesActionsTest-1043955423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.368s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:10 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:11 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-1c2b6927-9b53-4eb3-a310-7ce63234d4dd tempest-VolumesActionsTest-1043955423 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:05:11 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-1c2b6927-9b53-4eb3-a310-7ce63234d4dd tempest-VolumesActionsTest-1043955423 None] Deleted volume successfully. Jul 14 13:05:11 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1c2b6927-9b53-4eb3-a310-7ce63234d4dd tempest-VolumesActionsTest-1043955423 None] Lock "cinder-76fd8180-6000-410f-807f-9c45097667f9-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:11 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-049738d5-2c88-4aa5-9dda-82e3f0e56395" returned: 0 in 0.358s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:05:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0e35b0-86fc-4693-a7da-b843eced0721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-049738d5-2c88-4aa5-9dda-82e3f0e56395', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (213bcba4-0019-499e-996f-7228dffceaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:11 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Volume volume-049738d5-2c88-4aa5-9dda-82e3f0e56395 (049738d5-2c88-4aa5-9dda-82e3f0e56395): created successfully Jul 14 13:05:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (213bcba4-0019-499e-996f-7228dffceaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Flow 'volume_create_manager' (14a9d3fe-0855-4302-aad4-69aecf34132b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:11 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-f678c722-41de-4203-9986-408118e23d04 tempest-VolumesListAdminTestJSON-1030655228 None] Created volume successfully. Jul 14 13:05:12 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:05:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Flow 'volume_create_manager' (7b3dc743-5315-455e-89d9-559f665abc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39e76fa-0d1c-47dd-8366-84171ef99f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39e76fa-0d1c-47dd-8366-84171ef99f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-397220880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6573bb21-a878-4003-b499-28d4530ea6fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9138d66b3a484402a3ea3143fec385f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:13Z,use_quota=True,user_id='5fa471e8565b451099f983b67e6bc6c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9754cd64-153f-4a33-a5da-7301e0aa80fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9754cd64-153f-4a33-a5da-7301e0aa80fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c69e9b-e9e8-4432-9f94-afba7c5a29ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c69e9b-e9e8-4432-9f94-afba7c5a29ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6573bb21-a878-4003-b499-28d4530ea6fe', 'volume_name': 'volume-6573bb21-a878-4003-b499-28d4530ea6fe', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dcde605-550e-444c-9a10-bedc69ce7668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dcde605-550e-444c-9a10-bedc69ce7668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73fa6d8d-24ff-4972-8783-a657ee3e922f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:12 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Volume 6573bb21-a878-4003-b499-28d4530ea6fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6573bb21-a878-4003-b499-28d4530ea6fe', 'volume_size': 1} Jul 14 13:05:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-397220880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6573bb21-a878-4003-b499-28d4530ea6fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9138d66b3a484402a3ea3143fec385f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:13Z,use_quota=True,user_id='5fa471e8565b451099f983b67e6bc6c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:05:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Creating volume 6573bb21-a878-4003-b499-28d4530ea6fe {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:05:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:05:12 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:05:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6573bb21-a878-4003-b499-28d4530ea6fe 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:12 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6573bb21-a878-4003-b499-28d4530ea6fe 1073741824 Jul 14 13:05:12 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:13 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6573bb21-a878-4003-b499-28d4530ea6fe 1073741824" returned: 0 in 0.590s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6573bb21-a878-4003-b499-28d4530ea6fe {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:13 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6573bb21-a878-4003-b499-28d4530ea6fe Jul 14 13:05:13 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:13 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6573bb21-a878-4003-b499-28d4530ea6fe" returned: 0 in 0.336s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:05:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73fa6d8d-24ff-4972-8783-a657ee3e922f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6573bb21-a878-4003-b499-28d4530ea6fe', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde8ea1e-93a3-40c4-b8bf-52bfaaa7416f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:13 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Volume volume-6573bb21-a878-4003-b499-28d4530ea6fe (6573bb21-a878-4003-b499-28d4530ea6fe): created successfully Jul 14 13:05:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde8ea1e-93a3-40c4-b8bf-52bfaaa7416f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Flow 'volume_create_manager' (7b3dc743-5315-455e-89d9-559f665abc05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:13 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-1167dc5d-b745-41c8-a3e4-77c5a447eecc tempest-VolumesListAdminTestJSON-1030655228 None] Created volume successfully. Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Flow 'volume_create_manager' (1b90300f-c10f-4f9c-aefe-217535244656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97d53854-8184-4c9e-ab8b-4af4a2983d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97d53854-8184-4c9e-ab8b-4af4a2983d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd6556b-4c8c-480c-8242-a5308124afbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859840bd086440819a52f7e96d539657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:16Z,use_quota=True,user_id='6b1c03f1745648d697d8266e36a9cb57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f354a40c-77f3-4652-a76b-b1e2d3823340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f354a40c-77f3-4652-a76b-b1e2d3823340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c93667cf-39c6-42ff-9319-acf9c30249c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c93667cf-39c6-42ff-9319-acf9c30249c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bd6556b-4c8c-480c-8242-a5308124afbd', 'volume_name': 'volume-7bd6556b-4c8c-480c-8242-a5308124afbd', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043f8eb5-2c63-4ac5-8349-e6e1623cfb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043f8eb5-2c63-4ac5-8349-e6e1623cfb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e128183-3e61-48e1-aa30-d322c44866f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:15 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Volume 7bd6556b-4c8c-480c-8242-a5308124afbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bd6556b-4c8c-480c-8242-a5308124afbd', 'volume_size': 1} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd6556b-4c8c-480c-8242-a5308124afbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='859840bd086440819a52f7e96d539657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:16Z,use_quota=True,user_id='6b1c03f1745648d697d8266e36a9cb57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Creating volume 7bd6556b-4c8c-480c-8242-a5308124afbd {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:05:15 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7bd6556b-4c8c-480c-8242-a5308124afbd 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:05:15 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7bd6556b-4c8c-480c-8242-a5308124afbd 1073741824 Jul 14 13:05:15 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Flow 'volume_create_manager' (afb98471-4838-491f-899c-e2b1223d861d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9309cf3f-82e1-4f07-a2e6-f5af8ac6cc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9309cf3f-82e1-4f07-a2e6-f5af8ac6cc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1382733401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b314aef8-264b-43a9-a5a0-642a14e9e824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629b7355b5d64d0aa640698a15c46184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:16Z,use_quota=True,user_id='565997e01eb24bd792a1b12c9fc12917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3deb8fc0-326b-4e10-8675-1bbe21fa861e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3deb8fc0-326b-4e10-8675-1bbe21fa861e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30df6779-7fe0-4d3e-bd34-764be3c7c443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30df6779-7fe0-4d3e-bd34-764be3c7c443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b314aef8-264b-43a9-a5a0-642a14e9e824', 'volume_name': 'volume-b314aef8-264b-43a9-a5a0-642a14e9e824', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30432469-7eae-48a9-b5aa-8d247a75f14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30432469-7eae-48a9-b5aa-8d247a75f14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb4ff0d-2d86-4a1d-8a41-4bd9509c8136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:16 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Volume b314aef8-264b-43a9-a5a0-642a14e9e824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b314aef8-264b-43a9-a5a0-642a14e9e824', 'volume_size': 1} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:16 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7bd6556b-4c8c-480c-8242-a5308124afbd 1073741824" returned: 0 in 0.457s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7bd6556b-4c8c-480c-8242-a5308124afbd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:16 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7bd6556b-4c8c-480c-8242-a5308124afbd Jul 14 13:05:16 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:16 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:05:16 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:16 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7bd6556b-4c8c-480c-8242-a5308124afbd" returned: 0 in 0.397s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.775s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1382733401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b314aef8-264b-43a9-a5a0-642a14e9e824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629b7355b5d64d0aa640698a15c46184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:16Z,use_quota=True,user_id='565997e01eb24bd792a1b12c9fc12917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Creating volume b314aef8-264b-43a9-a5a0-642a14e9e824 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:05:16 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b314aef8-264b-43a9-a5a0-642a14e9e824 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:16 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.330s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 28 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e128183-3e61-48e1-aa30-d322c44866f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bd6556b-4c8c-480c-8242-a5308124afbd', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:16 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b314aef8-264b-43a9-a5a0-642a14e9e824 1073741824 Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c16dd7b7-1f69-45f4-a6a9-d953a3b373da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:16 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:16 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Volume volume-7bd6556b-4c8c-480c-8242-a5308124afbd (7bd6556b-4c8c-480c-8242-a5308124afbd): created successfully Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c16dd7b7-1f69-45f4-a6a9-d953a3b373da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Flow 'volume_create_manager' (1b90300f-c10f-4f9c-aefe-217535244656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:16 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-a35b9c46-f0eb-4150-888d-3845aefd58f6 tempest-VolumesListAdminTestJSON-562090242 None] Created volume successfully. Jul 14 13:05:17 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b314aef8-264b-43a9-a5a0-642a14e9e824 1073741824" returned: 0 in 0.496s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b314aef8-264b-43a9-a5a0-642a14e9e824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:17 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b314aef8-264b-43a9-a5a0-642a14e9e824 Jul 14 13:05:17 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:17 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b314aef8-264b-43a9-a5a0-642a14e9e824" returned: 0 in 0.299s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:05:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb4ff0d-2d86-4a1d-8a41-4bd9509c8136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b314aef8-264b-43a9-a5a0-642a14e9e824', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc16c4b-66fe-40c0-b745-63bfa0df79c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:17 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Volume volume-b314aef8-264b-43a9-a5a0-642a14e9e824 (b314aef8-264b-43a9-a5a0-642a14e9e824): created successfully Jul 14 13:05:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc16c4b-66fe-40c0-b745-63bfa0df79c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Flow 'volume_create_manager' (afb98471-4838-491f-899c-e2b1223d861d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:17 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-7c842b5e-4251-4541-b5aa-de0eddcb228a tempest-VolumesActionsTest-1043955423 None] Created volume successfully. Jul 14 13:05:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7fe78e66-8fbc-4c80-ab59-ffee9f449f8a tempest-VolumesListAdminTestJSON-562090242 None] Acquiring lock "cinder-7bd6556b-4c8c-480c-8242-a5308124afbd-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7fe78e66-8fbc-4c80-ab59-ffee9f449f8a tempest-VolumesListAdminTestJSON-562090242 None] Lock "cinder-7bd6556b-4c8c-480c-8242-a5308124afbd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7fe78e66-8fbc-4c80-ab59-ffee9f449f8a tempest-VolumesListAdminTestJSON-562090242 None] Acquiring lock "cinder-quobyte-7bd6556b-4c8c-480c-8242-a5308124afbd" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7fe78e66-8fbc-4c80-ab59-ffee9f449f8a tempest-VolumesListAdminTestJSON-562090242 None] Lock "cinder-quobyte-7bd6556b-4c8c-480c-8242-a5308124afbd" acquired by "delete_volume" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:17 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8ed480-dc06-464b-8416-973ba15b7e51]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:05:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7fe78e66-8fbc-4c80-ab59-ffee9f449f8a tempest-VolumesListAdminTestJSON-562090242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7bd6556b-4c8c-480c-8242-a5308124afbd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1195bfe-0779-47e6-86de-2cb22a77e376 tempest-VolumesListAdminTestJSON-1030655228 None] Acquiring lock "cinder-6573bb21-a878-4003-b499-28d4530ea6fe-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1195bfe-0779-47e6-86de-2cb22a77e376 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "cinder-6573bb21-a878-4003-b499-28d4530ea6fe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1195bfe-0779-47e6-86de-2cb22a77e376 tempest-VolumesListAdminTestJSON-1030655228 None] Acquiring lock "cinder-quobyte-6573bb21-a878-4003-b499-28d4530ea6fe" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1195bfe-0779-47e6-86de-2cb22a77e376 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "cinder-quobyte-6573bb21-a878-4003-b499-28d4530ea6fe" acquired by "delete_volume" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:18 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca072a51-d1fd-4792-8a97-24c08881a5cf]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:05:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1195bfe-0779-47e6-86de-2cb22a77e376 tempest-VolumesListAdminTestJSON-1030655228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6573bb21-a878-4003-b499-28d4530ea6fe {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:18 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7bd6556b-4c8c-480c-8242-a5308124afbd Jul 14 13:05:18 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:18 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6573bb21-a878-4003-b499-28d4530ea6fe Jul 14 13:05:18 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:18 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7fe78e66-8fbc-4c80-ab59-ffee9f449f8a tempest-VolumesListAdminTestJSON-562090242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7bd6556b-4c8c-480c-8242-a5308124afbd" returned: 0 in 0.462s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7fe78e66-8fbc-4c80-ab59-ffee9f449f8a tempest-VolumesListAdminTestJSON-562090242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7bd6556b-4c8c-480c-8242-a5308124afbd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:18 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7bd6556b-4c8c-480c-8242-a5308124afbd Jul 14 13:05:18 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:18 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1195bfe-0779-47e6-86de-2cb22a77e376 tempest-VolumesListAdminTestJSON-1030655228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6573bb21-a878-4003-b499-28d4530ea6fe" returned: 0 in 0.384s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1195bfe-0779-47e6-86de-2cb22a77e376 tempest-VolumesListAdminTestJSON-1030655228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6573bb21-a878-4003-b499-28d4530ea6fe {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:18 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6573bb21-a878-4003-b499-28d4530ea6fe Jul 14 13:05:18 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:18 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7fe78e66-8fbc-4c80-ab59-ffee9f449f8a tempest-VolumesListAdminTestJSON-562090242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7bd6556b-4c8c-480c-8242-a5308124afbd" returned: 0 in 0.296s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7fe78e66-8fbc-4c80-ab59-ffee9f449f8a tempest-VolumesListAdminTestJSON-562090242 None] Lock "cinder-quobyte-7bd6556b-4c8c-480c-8242-a5308124afbd" released by "delete_volume" :: held 0.814s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:18 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-7fe78e66-8fbc-4c80-ab59-ffee9f449f8a tempest-VolumesListAdminTestJSON-562090242 None] Created reservations ['30161b3f-edca-4ca2-a06c-4adf492d44ca', 'c8056918-6992-45a5-90fb-a410903eb4f2', 'e068f4b6-2df6-4933-ba51-4720ddfc719f', '68afaf4a-38a6-466f-bd7a-86e6597cc637'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:05:18 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1195bfe-0779-47e6-86de-2cb22a77e376 tempest-VolumesListAdminTestJSON-1030655228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6573bb21-a878-4003-b499-28d4530ea6fe" returned: 0 in 0.325s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1195bfe-0779-47e6-86de-2cb22a77e376 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "cinder-quobyte-6573bb21-a878-4003-b499-28d4530ea6fe" released by "delete_volume" :: held 0.763s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7fe78e66-8fbc-4c80-ab59-ffee9f449f8a tempest-VolumesListAdminTestJSON-562090242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7fe78e66-8fbc-4c80-ab59-ffee9f449f8a tempest-VolumesListAdminTestJSON-562090242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7fe78e66-8fbc-4c80-ab59-ffee9f449f8a tempest-VolumesListAdminTestJSON-562090242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7fe78e66-8fbc-4c80-ab59-ffee9f449f8a tempest-VolumesListAdminTestJSON-562090242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7fe78e66-8fbc-4c80-ab59-ffee9f449f8a tempest-VolumesListAdminTestJSON-562090242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7fe78e66-8fbc-4c80-ab59-ffee9f449f8a tempest-VolumesListAdminTestJSON-562090242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:18 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-c1195bfe-0779-47e6-86de-2cb22a77e376 tempest-VolumesListAdminTestJSON-1030655228 None] Created reservations ['3f37728c-9298-44bd-a995-849462758d12', '73fccb4e-4d11-4d98-aa6c-36d2327bd2f1', '574340aa-2df0-4f8e-b726-dbb237389348', '3e3bb2bd-417c-4806-9d68-92dfb1888b84'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:05:18 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:05:18 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e4e5abf8-346d-4b7c-9f5a-96a761e5794e tempest-VolumesActionsTest-1708452664 None] Acquiring lock "cinder-b314aef8-264b-43a9-a5a0-642a14e9e824-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e4e5abf8-346d-4b7c-9f5a-96a761e5794e tempest-VolumesActionsTest-1708452664 None] Lock "cinder-b314aef8-264b-43a9-a5a0-642a14e9e824-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c1195bfe-0779-47e6-86de-2cb22a77e376 tempest-VolumesListAdminTestJSON-1030655228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c1195bfe-0779-47e6-86de-2cb22a77e376 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c1195bfe-0779-47e6-86de-2cb22a77e376 tempest-VolumesListAdminTestJSON-1030655228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c1195bfe-0779-47e6-86de-2cb22a77e376 tempest-VolumesListAdminTestJSON-1030655228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c1195bfe-0779-47e6-86de-2cb22a77e376 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1195bfe-0779-47e6-86de-2cb22a77e376 tempest-VolumesListAdminTestJSON-1030655228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:19 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:05:19 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e4e5abf8-346d-4b7c-9f5a-96a761e5794e tempest-VolumesActionsTest-1708452664 None] Acquiring lock "cinder-quobyte-b314aef8-264b-43a9-a5a0-642a14e9e824" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e4e5abf8-346d-4b7c-9f5a-96a761e5794e tempest-VolumesActionsTest-1708452664 None] Lock "cinder-quobyte-b314aef8-264b-43a9-a5a0-642a14e9e824" acquired by "delete_volume" :: waited 0.041s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[802f1a74-4c4e-4f02-a448-e2264b8834ac]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e4e5abf8-346d-4b7c-9f5a-96a761e5794e tempest-VolumesActionsTest-1708452664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b314aef8-264b-43a9-a5a0-642a14e9e824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-57e41945-d08f-47da-b8df-acea6270c8a2 tempest-VolumesListAdminTestJSON-1030655228 None] Acquiring lock "cinder-049738d5-2c88-4aa5-9dda-82e3f0e56395-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:19 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7fe78e66-8fbc-4c80-ab59-ffee9f449f8a tempest-VolumesListAdminTestJSON-562090242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.472s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-7fe78e66-8fbc-4c80-ab59-ffee9f449f8a tempest-VolumesListAdminTestJSON-562090242 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-57e41945-d08f-47da-b8df-acea6270c8a2 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "cinder-049738d5-2c88-4aa5-9dda-82e3f0e56395-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:19 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-7fe78e66-8fbc-4c80-ab59-ffee9f449f8a tempest-VolumesListAdminTestJSON-562090242 None] Deleted volume successfully. Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7fe78e66-8fbc-4c80-ab59-ffee9f449f8a tempest-VolumesListAdminTestJSON-562090242 None] Lock "cinder-7bd6556b-4c8c-480c-8242-a5308124afbd-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-57e41945-d08f-47da-b8df-acea6270c8a2 tempest-VolumesListAdminTestJSON-1030655228 None] Acquiring lock "cinder-quobyte-049738d5-2c88-4aa5-9dda-82e3f0e56395" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-57e41945-d08f-47da-b8df-acea6270c8a2 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "cinder-quobyte-049738d5-2c88-4aa5-9dda-82e3f0e56395" acquired by "delete_volume" :: waited 0.029s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[2941e330-4666-44d7-9a06-1e76e982f15a]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-57e41945-d08f-47da-b8df-acea6270c8a2 tempest-VolumesListAdminTestJSON-1030655228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-049738d5-2c88-4aa5-9dda-82e3f0e56395 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:19 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1195bfe-0779-47e6-86de-2cb22a77e376 tempest-VolumesListAdminTestJSON-1030655228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.428s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-c1195bfe-0779-47e6-86de-2cb22a77e376 tempest-VolumesListAdminTestJSON-1030655228 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:05:19 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b314aef8-264b-43a9-a5a0-642a14e9e824 Jul 14 13:05:19 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c1195bfe-0779-47e6-86de-2cb22a77e376 tempest-VolumesListAdminTestJSON-1030655228 None] Deleted volume successfully. Jul 14 13:05:19 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1195bfe-0779-47e6-86de-2cb22a77e376 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "cinder-6573bb21-a878-4003-b499-28d4530ea6fe-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:19 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-049738d5-2c88-4aa5-9dda-82e3f0e56395 Jul 14 13:05:19 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Flow 'volume_create_manager' (d22b05af-4acb-4f15-baf6-c6e8ffc5c852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e98a059-efa6-4b30-9a4e-18e38ca9cddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e98a059-efa6-4b30-9a4e-18e38ca9cddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-534287874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d28844-92fd-471c-9625-788625ed95c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d64c34f1b96407ca76003fbd6685baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:20Z,use_quota=True,user_id='2bfebecf4a884f4aabc310fb5430eae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a12ee0a9-ced0-4858-8142-317906cfe114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a12ee0a9-ced0-4858-8142-317906cfe114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa7257a1-892e-431d-b46c-ca7a6e028580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG cinder.image.glance [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Creating Keystone auth plugin from conf {{(pid=86977) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 13:05:19 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e4e5abf8-346d-4b7c-9f5a-96a761e5794e tempest-VolumesActionsTest-1708452664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b314aef8-264b-43a9-a5a0-642a14e9e824" returned: 0 in 0.546s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e4e5abf8-346d-4b7c-9f5a-96a761e5794e tempest-VolumesActionsTest-1708452664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b314aef8-264b-43a9-a5a0-642a14e9e824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:19 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b314aef8-264b-43a9-a5a0-642a14e9e824 Jul 14 13:05:19 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:19 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-57e41945-d08f-47da-b8df-acea6270c8a2 tempest-VolumesListAdminTestJSON-1030655228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-049738d5-2c88-4aa5-9dda-82e3f0e56395" returned: 0 in 0.426s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-57e41945-d08f-47da-b8df-acea6270c8a2 tempest-VolumesListAdminTestJSON-1030655228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-049738d5-2c88-4aa5-9dda-82e3f0e56395 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:19 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-049738d5-2c88-4aa5-9dda-82e3f0e56395 Jul 14 13:05:19 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:20 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e4e5abf8-346d-4b7c-9f5a-96a761e5794e tempest-VolumesActionsTest-1708452664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b314aef8-264b-43a9-a5a0-642a14e9e824" returned: 0 in 0.281s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e4e5abf8-346d-4b7c-9f5a-96a761e5794e tempest-VolumesActionsTest-1708452664 None] Lock "cinder-quobyte-b314aef8-264b-43a9-a5a0-642a14e9e824" released by "delete_volume" :: held 0.903s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa7257a1-892e-431d-b46c-ca7a6e028580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c3d28844-92fd-471c-9625-788625ed95c9', 'volume_name': 'volume-c3d28844-92fd-471c-9625-788625ed95c9', 'volume_size': 1, 'image_id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cc8c62448314c45912011edd3ae5374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'created_at': datetime.datetime(2026, 7, 14, 10, 49, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 10, 49, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33abf4a9-ef06-4448-a45c-b53dca509874/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffae2e9c-1bc8-49c2-9438-cab3c4cf7837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffae2e9c-1bc8-49c2-9438-cab3c4cf7837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e8e485-69ba-418d-b969-d99cc35d313a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:20 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Volume c3d28844-92fd-471c-9625-788625ed95c9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c3d28844-92fd-471c-9625-788625ed95c9', 'volume_size': 1, 'image_id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cc8c62448314c45912011edd3ae5374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'created_at': datetime.datetime(2026, 7, 14, 10, 49, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 10, 49, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33abf4a9-ef06-4448-a45c-b53dca509874/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Trying to clone c3d28844-92fd-471c-9625-788625ed95c9 from image 33abf4a9-ef06-4448-a45c-b53dca509874 at location (None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}]). {{(pid=86977) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 13:05:20 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-57e41945-d08f-47da-b8df-acea6270c8a2 tempest-VolumesListAdminTestJSON-1030655228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-049738d5-2c88-4aa5-9dda-82e3f0e56395" returned: 0 in 0.273s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-57e41945-d08f-47da-b8df-acea6270c8a2 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "cinder-quobyte-049738d5-2c88-4aa5-9dda-82e3f0e56395" released by "delete_volume" :: held 0.747s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-e4e5abf8-346d-4b7c-9f5a-96a761e5794e tempest-VolumesActionsTest-1708452664 None] Created reservations ['92626699-e2fa-4915-8d61-4709bcb9586f', '0e86cbb2-dc79-48bf-aefd-ec0df802e11a', 'fe0d4b8c-9e0d-4663-b123-ab5d4efa882e', 'aa62d50c-8227-4273-a704-293861f06f31'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-57e41945-d08f-47da-b8df-acea6270c8a2 tempest-VolumesListAdminTestJSON-1030655228 None] Created reservations ['38a67dc7-bad4-47c8-8f7f-7eeb84745394', 'f45ccd65-df82-4c33-a712-f6579d8763e6', '5d5f1b05-96dc-4460-8e65-48a5ebdc9b54', 'a6905c0d-4a73-4a48-bf8f-69c45384e045'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e4e5abf8-346d-4b7c-9f5a-96a761e5794e tempest-VolumesActionsTest-1708452664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e4e5abf8-346d-4b7c-9f5a-96a761e5794e tempest-VolumesActionsTest-1708452664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e4e5abf8-346d-4b7c-9f5a-96a761e5794e tempest-VolumesActionsTest-1708452664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e4e5abf8-346d-4b7c-9f5a-96a761e5794e tempest-VolumesActionsTest-1708452664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e4e5abf8-346d-4b7c-9f5a-96a761e5794e tempest-VolumesActionsTest-1708452664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e4e5abf8-346d-4b7c-9f5a-96a761e5794e tempest-VolumesActionsTest-1708452664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:20 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:05:20 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-57e41945-d08f-47da-b8df-acea6270c8a2 tempest-VolumesListAdminTestJSON-1030655228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-57e41945-d08f-47da-b8df-acea6270c8a2 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-57e41945-d08f-47da-b8df-acea6270c8a2 tempest-VolumesListAdminTestJSON-1030655228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-57e41945-d08f-47da-b8df-acea6270c8a2 tempest-VolumesListAdminTestJSON-1030655228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-57e41945-d08f-47da-b8df-acea6270c8a2 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-57e41945-d08f-47da-b8df-acea6270c8a2 tempest-VolumesListAdminTestJSON-1030655228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:20 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:05:20 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_n5ac3_6odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:751}} Jul 14 13:05:20 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Image download 20.69 MB at 20.69 MB/s Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-24651ea2-a60f-45fd-b077-7efbf5469568 tempest-VolumesListAdminTestJSON-1030655228 None] Acquiring lock "cinder-7cd06ed3-6d6f-489d-b2c9-79c7af406f90-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-24651ea2-a60f-45fd-b077-7efbf5469568 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "cinder-7cd06ed3-6d6f-489d-b2c9-79c7af406f90-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-24651ea2-a60f-45fd-b077-7efbf5469568 tempest-VolumesListAdminTestJSON-1030655228 None] Acquiring lock "cinder-quobyte-7cd06ed3-6d6f-489d-b2c9-79c7af406f90" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-24651ea2-a60f-45fd-b077-7efbf5469568 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "cinder-quobyte-7cd06ed3-6d6f-489d-b2c9-79c7af406f90" acquired by "delete_volume" :: waited 0.030s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fedb6a8-c067-48f1-a2c1-1d5f0de7abf1]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_n5ac3_6odevstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e9962a-2aa5-4089-b447-616e305cc164]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-24651ea2-a60f-45fd-b077-7efbf5469568 tempest-VolumesListAdminTestJSON-1030655228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7cd06ed3-6d6f-489d-b2c9-79c7af406f90 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:20 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e4e5abf8-346d-4b7c-9f5a-96a761e5794e tempest-VolumesActionsTest-1708452664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.400s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-e4e5abf8-346d-4b7c-9f5a-96a761e5794e tempest-VolumesActionsTest-1708452664 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:05:20 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e4e5abf8-346d-4b7c-9f5a-96a761e5794e tempest-VolumesActionsTest-1708452664 None] Deleted volume successfully. Jul 14 13:05:20 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_n5ac3_6odevstack@QuobyteHD Jul 14 13:05:20 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:20 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e4e5abf8-346d-4b7c-9f5a-96a761e5794e tempest-VolumesActionsTest-1708452664 None] Lock "cinder-b314aef8-264b-43a9-a5a0-642a14e9e824-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-57e41945-d08f-47da-b8df-acea6270c8a2 tempest-VolumesListAdminTestJSON-1030655228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.326s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-57e41945-d08f-47da-b8df-acea6270c8a2 tempest-VolumesListAdminTestJSON-1030655228 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:05:20 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-57e41945-d08f-47da-b8df-acea6270c8a2 tempest-VolumesListAdminTestJSON-1030655228 None] Deleted volume successfully. Jul 14 13:05:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-57e41945-d08f-47da-b8df-acea6270c8a2 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "cinder-049738d5-2c88-4aa5-9dda-82e3f0e56395-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:20 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7cd06ed3-6d6f-489d-b2c9-79c7af406f90 Jul 14 13:05:20 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:21 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_n5ac3_6odevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Temporary image 33abf4a9-ef06-4448-a45c-b53dca509874 is fetched for user 2bfebecf4a884f4aabc310fb5430eae4. {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:1450}} Jul 14 13:05:21 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-24651ea2-a60f-45fd-b077-7efbf5469568 tempest-VolumesListAdminTestJSON-1030655228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7cd06ed3-6d6f-489d-b2c9-79c7af406f90" returned: 0 in 0.382s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-24651ea2-a60f-45fd-b077-7efbf5469568 tempest-VolumesListAdminTestJSON-1030655228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7cd06ed3-6d6f-489d-b2c9-79c7af406f90 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[3995b748-53bd-4e5b-8bbc-075019dc311f]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_n5ac3_6odevstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:21 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7cd06ed3-6d6f-489d-b2c9-79c7af406f90 Jul 14 13:05:21 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:21 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_n5ac3_6odevstack@QuobyteHD Jul 14 13:05:21 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:21 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-24651ea2-a60f-45fd-b077-7efbf5469568 tempest-VolumesListAdminTestJSON-1030655228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7cd06ed3-6d6f-489d-b2c9-79c7af406f90" returned: 0 in 0.264s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-24651ea2-a60f-45fd-b077-7efbf5469568 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "cinder-quobyte-7cd06ed3-6d6f-489d-b2c9-79c7af406f90" released by "delete_volume" :: held 0.710s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-24651ea2-a60f-45fd-b077-7efbf5469568 tempest-VolumesListAdminTestJSON-1030655228 None] Created reservations ['cd62b3d3-521d-420c-ab31-1e793626f9cc', 'fb8f6418-6eb1-4264-a0e4-50e69d421841', '59f1f191-fc48-4bdd-a350-f23357585e1c', '93803953-c070-415c-b936-5aaf365a86fa'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:05:21 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_n5ac3_6odevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-534287874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d28844-92fd-471c-9625-788625ed95c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d64c34f1b96407ca76003fbd6685baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:20Z,use_quota=True,user_id='2bfebecf4a884f4aabc310fb5430eae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Creating volume c3d28844-92fd-471c-9625-788625ed95c9 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:05:21 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-24651ea2-a60f-45fd-b077-7efbf5469568 tempest-VolumesListAdminTestJSON-1030655228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-24651ea2-a60f-45fd-b077-7efbf5469568 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-24651ea2-a60f-45fd-b077-7efbf5469568 tempest-VolumesListAdminTestJSON-1030655228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-24651ea2-a60f-45fd-b077-7efbf5469568 tempest-VolumesListAdminTestJSON-1030655228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-24651ea2-a60f-45fd-b077-7efbf5469568 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-24651ea2-a60f-45fd-b077-7efbf5469568 tempest-VolumesListAdminTestJSON-1030655228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:21 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 1073741824 Jul 14 13:05:21 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:21 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:05:21 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Flow 'volume_create_manager' (3df8e24a-07cb-4fb1-9c1c-c0dfa23012a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81bc6cb6-1be2-4030-9982-3e9cbaf0d150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81bc6cb6-1be2-4030-9982-3e9cbaf0d150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1363519378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9864984-9dc0-4284-9383-140f6e85c29a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629b7355b5d64d0aa640698a15c46184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:22Z,use_quota=True,user_id='565997e01eb24bd792a1b12c9fc12917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c78c646-6b3f-43bc-958c-dc768a1ed6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c78c646-6b3f-43bc-958c-dc768a1ed6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1001a7-3f08-491d-af5c-81ba9c377648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1001a7-3f08-491d-af5c-81ba9c377648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9864984-9dc0-4284-9383-140f6e85c29a', 'volume_name': 'volume-b9864984-9dc0-4284-9383-140f6e85c29a', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e82eeb5-6f9c-43ba-98b9-658f47b3e350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e82eeb5-6f9c-43ba-98b9-658f47b3e350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:21 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d2a82f-aa2b-447d-87c9-3bacba640d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:21 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Volume b9864984-9dc0-4284-9383-140f6e85c29a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9864984-9dc0-4284-9383-140f6e85c29a', 'volume_size': 1} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-24651ea2-a60f-45fd-b077-7efbf5469568 tempest-VolumesListAdminTestJSON-1030655228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.365s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-24651ea2-a60f-45fd-b077-7efbf5469568 tempest-VolumesListAdminTestJSON-1030655228 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:05:21 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-24651ea2-a60f-45fd-b077-7efbf5469568 tempest-VolumesListAdminTestJSON-1030655228 None] Deleted volume successfully. Jul 14 13:05:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-24651ea2-a60f-45fd-b077-7efbf5469568 tempest-VolumesListAdminTestJSON-1030655228 None] Lock "cinder-7cd06ed3-6d6f-489d-b2c9-79c7af406f90-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:22 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 1073741824" returned: 0 in 0.502s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:22 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 Jul 14 13:05:22 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:22 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9" returned: 0 in 0.248s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:05:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.401s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1363519378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9864984-9dc0-4284-9383-140f6e85c29a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629b7355b5d64d0aa640698a15c46184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:22Z,use_quota=True,user_id='565997e01eb24bd792a1b12c9fc12917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:05:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Creating volume b9864984-9dc0-4284-9383-140f6e85c29a {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:05:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:05:22 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:05:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9864984-9dc0-4284-9383-140f6e85c29a 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:22 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9864984-9dc0-4284-9383-140f6e85c29a 1073741824 Jul 14 13:05:22 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:22 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Attempting download of 33abf4a9-ef06-4448-a45c-b53dca509874 ((None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}])) to volume c3d28844-92fd-471c-9625-788625ed95c9. {{(pid=86977) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 13:05:22 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[918084e0-6a9e-4b19-b322-d461fb523628]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:05:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_87wm0td7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:22 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_87wm0td7 Jul 14 13:05:22 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:22 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_87wm0td7" returned: 0 in 0.409s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_87wm0td7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:22 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9864984-9dc0-4284-9383-140f6e85c29a 1073741824" returned: 0 in 0.530s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9864984-9dc0-4284-9383-140f6e85c29a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:22 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9864984-9dc0-4284-9383-140f6e85c29a Jul 14 13:05:22 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:22 devstack sudo[97978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_87wm0td7 Jul 14 13:05:22 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:23 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9864984-9dc0-4284-9383-140f6e85c29a" returned: 0 in 0.264s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:05:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d2a82f-aa2b-447d-87c9-3bacba640d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9864984-9dc0-4284-9383-140f6e85c29a', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661b55eb-a41c-4b68-b57f-d340826745dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:23 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_87wm0td7" returned: 1 in 0.375s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33abf4a9-ef06-4448-a45c-b53dca509874_87wm0td7' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:05:23 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Volume volume-b9864984-9dc0-4284-9383-140f6e85c29a (b9864984-9dc0-4284-9383-140f6e85c29a): created successfully Jul 14 13:05:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661b55eb-a41c-4b68-b57f-d340826745dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Flow 'volume_create_manager' (3df8e24a-07cb-4fb1-9c1c-c0dfa23012a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:23 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5db8275-df1d-44e4-9324-c21c4730eb1d]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:05:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_n5ac3_6odevstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:23 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e4218646-8df1-4354-9f7d-c720376a83d4 tempest-VolumesActionsTest-1043955423 None] Created volume successfully. Jul 14 13:05:23 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_n5ac3_6odevstack@QuobyteHD Jul 14 13:05:23 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:23 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_n5ac3_6odevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:23 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] 33abf4a9-ef06-4448-a45c-b53dca509874 was qcow2, converting to raw {{(pid=86977) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1139}} Jul 14 13:05:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_n5ac3_6odevstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:23 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_n5ac3_6odevstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 Jul 14 13:05:23 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b6b879b5-1214-4a93-ae0a-e80797abbee5 tempest-VolumesActionsTest-1708452664 None] Acquiring lock "cinder-b9864984-9dc0-4284-9383-140f6e85c29a-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b6b879b5-1214-4a93-ae0a-e80797abbee5 tempest-VolumesActionsTest-1708452664 None] Lock "cinder-b9864984-9dc0-4284-9383-140f6e85c29a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b6b879b5-1214-4a93-ae0a-e80797abbee5 tempest-VolumesActionsTest-1708452664 None] Acquiring lock "cinder-quobyte-b9864984-9dc0-4284-9383-140f6e85c29a" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b6b879b5-1214-4a93-ae0a-e80797abbee5 tempest-VolumesActionsTest-1708452664 None] Lock "cinder-quobyte-b9864984-9dc0-4284-9383-140f6e85c29a" acquired by "delete_volume" :: waited 0.023s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:24 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4052156-8bdf-4375-91c0-a19d7dd404de]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:05:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b6b879b5-1214-4a93-ae0a-e80797abbee5 tempest-VolumesActionsTest-1708452664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9864984-9dc0-4284-9383-140f6e85c29a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:24 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9864984-9dc0-4284-9383-140f6e85c29a Jul 14 13:05:24 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:24 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b6b879b5-1214-4a93-ae0a-e80797abbee5 tempest-VolumesActionsTest-1708452664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9864984-9dc0-4284-9383-140f6e85c29a" returned: 0 in 0.467s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b6b879b5-1214-4a93-ae0a-e80797abbee5 tempest-VolumesActionsTest-1708452664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9864984-9dc0-4284-9383-140f6e85c29a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:24 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9864984-9dc0-4284-9383-140f6e85c29a Jul 14 13:05:24 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:24 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b6b879b5-1214-4a93-ae0a-e80797abbee5 tempest-VolumesActionsTest-1708452664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b9864984-9dc0-4284-9383-140f6e85c29a" returned: 0 in 0.278s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b6b879b5-1214-4a93-ae0a-e80797abbee5 tempest-VolumesActionsTest-1708452664 None] Lock "cinder-quobyte-b9864984-9dc0-4284-9383-140f6e85c29a" released by "delete_volume" :: held 0.797s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-b6b879b5-1214-4a93-ae0a-e80797abbee5 tempest-VolumesActionsTest-1708452664 None] Created reservations ['c9be7f95-777b-45a3-b07a-650e617a47ad', 'bcc7f497-d2a6-414e-ad3c-7981e9160d38', 'fc0e5e21-b4ff-4620-a3cf-fa8ee7fa4649', '69f44595-c510-4f05-8755-225efb6c58e5'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b6b879b5-1214-4a93-ae0a-e80797abbee5 tempest-VolumesActionsTest-1708452664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b6b879b5-1214-4a93-ae0a-e80797abbee5 tempest-VolumesActionsTest-1708452664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b6b879b5-1214-4a93-ae0a-e80797abbee5 tempest-VolumesActionsTest-1708452664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b6b879b5-1214-4a93-ae0a-e80797abbee5 tempest-VolumesActionsTest-1708452664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b6b879b5-1214-4a93-ae0a-e80797abbee5 tempest-VolumesActionsTest-1708452664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b6b879b5-1214-4a93-ae0a-e80797abbee5 tempest-VolumesActionsTest-1708452664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:25 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:05:25 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:25 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_n5ac3_6odevstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9" returned: 0 in 1.866s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_33abf4a9-ef06-4448-a45c-b53dca509874_n5ac3_6odevstack@QuobyteHD, size 112.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:05:25 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Converted 112.00 MB image at 59.93 MB/s Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:25 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 1G Jul 14 13:05:25 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:25 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b6b879b5-1214-4a93-ae0a-e80797abbee5 tempest-VolumesActionsTest-1708452664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.382s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-b6b879b5-1214-4a93-ae0a-e80797abbee5 tempest-VolumesActionsTest-1708452664 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:05:25 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b6b879b5-1214-4a93-ae0a-e80797abbee5 tempest-VolumesActionsTest-1708452664 None] Deleted volume successfully. Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b6b879b5-1214-4a93-ae0a-e80797abbee5 tempest-VolumesActionsTest-1708452664 None] Lock "cinder-b9864984-9dc0-4284-9383-140f6e85c29a-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:25 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 1G" returned: 0 in 0.352s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[74145b57-2813-4318-a111-78ba989782a0]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Flow 'volume_create_manager' (1d308db8-94b2-4be1-8044-b59d8bbc6344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd91422f-ac1c-4da1-84d0-9627ac37d233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd91422f-ac1c-4da1-84d0-9627ac37d233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-791994809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa17dcf-136e-4b03-8f23-5abbd096324c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629b7355b5d64d0aa640698a15c46184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:26Z,use_quota=True,user_id='565997e01eb24bd792a1b12c9fc12917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f6109d-f2c6-4e96-b57c-59e4465528c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f6109d-f2c6-4e96-b57c-59e4465528c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d697ab4-f6d0-4462-a349-a5eb4eb50c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d697ab4-f6d0-4462-a349-a5eb4eb50c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfa17dcf-136e-4b03-8f23-5abbd096324c', 'volume_name': 'volume-dfa17dcf-136e-4b03-8f23-5abbd096324c', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfbe6dde-84c3-4177-80f5-e05b1ff3bb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfbe6dde-84c3-4177-80f5-e05b1ff3bb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d7f933-1725-4039-b1f8-951643b475c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:25 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Volume dfa17dcf-136e-4b03-8f23-5abbd096324c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfa17dcf-136e-4b03-8f23-5abbd096324c', 'volume_size': 1} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-791994809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa17dcf-136e-4b03-8f23-5abbd096324c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629b7355b5d64d0aa640698a15c46184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:26Z,use_quota=True,user_id='565997e01eb24bd792a1b12c9fc12917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Creating volume dfa17dcf-136e-4b03-8f23-5abbd096324c {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:05:25 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:05:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfa17dcf-136e-4b03-8f23-5abbd096324c 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:25 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 Jul 14 13:05:25 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:25 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfa17dcf-136e-4b03-8f23-5abbd096324c 1073741824 Jul 14 13:05:25 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:26 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9" returned: 0 in 0.422s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:26 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 Jul 14 13:05:26 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:26 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfa17dcf-136e-4b03-8f23-5abbd096324c 1073741824" returned: 0 in 0.495s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfa17dcf-136e-4b03-8f23-5abbd096324c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:26 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfa17dcf-136e-4b03-8f23-5abbd096324c Jul 14 13:05:26 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:26 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9" returned: 1 in 0.384s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:05:26 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Downloaded image 33abf4a9-ef06-4448-a45c-b53dca509874 ((None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}])) to volume c3d28844-92fd-471c-9625-788625ed95c9 successfully. {{(pid=86977) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 13:05:26 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Temporary image 33abf4a9-ef06-4448-a45c-b53dca509874 for user 2bfebecf4a884f4aabc310fb5430eae4 is deleted. {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:1454}} Jul 14 13:05:26 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Marking volume c3d28844-92fd-471c-9625-788625ed95c9 as bootable. {{(pid=86977) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 13:05:26 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Copying metadata from image 33abf4a9-ef06-4448-a45c-b53dca509874 to c3d28844-92fd-471c-9625-788625ed95c9. {{(pid=86977) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 13:05:26 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Creating volume glance metadata for volume c3d28844-92fd-471c-9625-788625ed95c9 backed by image 33abf4a9-ef06-4448-a45c-b53dca509874 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86977) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 13:05:26 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e8e485-69ba-418d-b969-d99cc35d313a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3d28844-92fd-471c-9625-788625ed95c9', 'volume_size': 1, 'image_id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33abf4a9-ef06-4448-a45c-b53dca509874', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1cc8c62448314c45912011edd3ae5374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33abf4a9-ef06-4448-a45c-b53dca509874', 'created_at': datetime.datetime(2026, 7, 14, 10, 49, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 10, 49, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33abf4a9-ef06-4448-a45c-b53dca509874/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:26 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e798f3-f2b2-4dc9-8d04-8e27b33662ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:26 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfa17dcf-136e-4b03-8f23-5abbd096324c" returned: 0 in 0.321s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:26 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:05:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:26 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Volume volume-c3d28844-92fd-471c-9625-788625ed95c9 (c3d28844-92fd-471c-9625-788625ed95c9): created successfully Jul 14 13:05:26 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e798f3-f2b2-4dc9-8d04-8e27b33662ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:26 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Flow 'volume_create_manager' (d22b05af-4acb-4f15-baf6-c6e8ffc5c852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:26 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d7f933-1725-4039-b1f8-951643b475c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfa17dcf-136e-4b03-8f23-5abbd096324c', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:26 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (469ef077-21ac-4505-9855-74ef142ba3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:26 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-fc6b5b6e-0e9f-4a7d-b23c-6112fb1b9672 tempest-TestShelveInstance-713317852 None] Created volume successfully. Jul 14 13:05:26 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Volume volume-dfa17dcf-136e-4b03-8f23-5abbd096324c (dfa17dcf-136e-4b03-8f23-5abbd096324c): created successfully Jul 14 13:05:26 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (469ef077-21ac-4505-9855-74ef142ba3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:26 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Flow 'volume_create_manager' (1d308db8-94b2-4be1-8044-b59d8bbc6344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:26 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b914116a-0b01-4a6c-aa02-e6f0795af2e4 tempest-VolumesActionsTest-1043955423 None] Created volume successfully. Jul 14 13:05:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-be1fee6b-fe37-4a54-95e3-bca990c8642f tempest-VolumesActionsTest-1708452664 None] Acquiring lock "cinder-dfa17dcf-136e-4b03-8f23-5abbd096324c-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-be1fee6b-fe37-4a54-95e3-bca990c8642f tempest-VolumesActionsTest-1708452664 None] Lock "cinder-dfa17dcf-136e-4b03-8f23-5abbd096324c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-be1fee6b-fe37-4a54-95e3-bca990c8642f tempest-VolumesActionsTest-1708452664 None] Acquiring lock "cinder-quobyte-dfa17dcf-136e-4b03-8f23-5abbd096324c" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-be1fee6b-fe37-4a54-95e3-bca990c8642f tempest-VolumesActionsTest-1708452664 None] Lock "cinder-quobyte-dfa17dcf-136e-4b03-8f23-5abbd096324c" acquired by "delete_volume" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:28 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccdf74d-b68b-4217-81dc-7df26e95b237]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:05:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-be1fee6b-fe37-4a54-95e3-bca990c8642f tempest-VolumesActionsTest-1708452664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfa17dcf-136e-4b03-8f23-5abbd096324c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:28 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfa17dcf-136e-4b03-8f23-5abbd096324c Jul 14 13:05:28 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:28 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-be1fee6b-fe37-4a54-95e3-bca990c8642f tempest-VolumesActionsTest-1708452664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfa17dcf-136e-4b03-8f23-5abbd096324c" returned: 0 in 0.442s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-be1fee6b-fe37-4a54-95e3-bca990c8642f tempest-VolumesActionsTest-1708452664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfa17dcf-136e-4b03-8f23-5abbd096324c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:28 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfa17dcf-136e-4b03-8f23-5abbd096324c Jul 14 13:05:28 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:29 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-be1fee6b-fe37-4a54-95e3-bca990c8642f tempest-VolumesActionsTest-1708452664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfa17dcf-136e-4b03-8f23-5abbd096324c" returned: 0 in 0.301s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-be1fee6b-fe37-4a54-95e3-bca990c8642f tempest-VolumesActionsTest-1708452664 None] Lock "cinder-quobyte-dfa17dcf-136e-4b03-8f23-5abbd096324c" released by "delete_volume" :: held 0.802s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:29 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-be1fee6b-fe37-4a54-95e3-bca990c8642f tempest-VolumesActionsTest-1708452664 None] Created reservations ['4dcf1338-e1f8-405c-92c2-cd632cc1f869', 'fb43d6a6-a5bc-4858-b11c-b159fe061598', '8ae6628a-688f-490d-96b3-33f7af2f2f54', 'b5def3c7-f558-4416-abb8-0a3f304494bb'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:05:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-be1fee6b-fe37-4a54-95e3-bca990c8642f tempest-VolumesActionsTest-1708452664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-be1fee6b-fe37-4a54-95e3-bca990c8642f tempest-VolumesActionsTest-1708452664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-be1fee6b-fe37-4a54-95e3-bca990c8642f tempest-VolumesActionsTest-1708452664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-be1fee6b-fe37-4a54-95e3-bca990c8642f tempest-VolumesActionsTest-1708452664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-be1fee6b-fe37-4a54-95e3-bca990c8642f tempest-VolumesActionsTest-1708452664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-be1fee6b-fe37-4a54-95e3-bca990c8642f tempest-VolumesActionsTest-1708452664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:29 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:05:29 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:29 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-be1fee6b-fe37-4a54-95e3-bca990c8642f tempest-VolumesActionsTest-1708452664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.380s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:29 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-be1fee6b-fe37-4a54-95e3-bca990c8642f tempest-VolumesActionsTest-1708452664 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:05:29 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-be1fee6b-fe37-4a54-95e3-bca990c8642f tempest-VolumesActionsTest-1708452664 None] Deleted volume successfully. Jul 14 13:05:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-be1fee6b-fe37-4a54-95e3-bca990c8642f tempest-VolumesActionsTest-1708452664 None] Lock "cinder-dfa17dcf-136e-4b03-8f23-5abbd096324c-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-c75b3eff-6e17-4445-a653-a51de18c3053 req-97745056-d405-421f-937e-38c04dca323d tempest-TestShelveInstance-713317852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-c75b3eff-6e17-4445-a653-a51de18c3053 req-97745056-d405-421f-937e-38c04dca323d tempest-TestShelveInstance-713317852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:30 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea18de99-546e-41de-ac37-1d336889acf5]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:05:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-c75b3eff-6e17-4445-a653-a51de18c3053 req-97745056-d405-421f-937e-38c04dca323d tempest-TestShelveInstance-713317852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:30 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:05:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Flow 'volume_create_manager' (0cf1aae8-9650-486e-a655-affd822dde6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62b9249-f373-4d79-9950-c0f8d60ca3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62b9249-f373-4d79-9950-c0f8d60ca3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-505876885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c795f3-1585-48e6-a563-71cda8ca8bed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629b7355b5d64d0aa640698a15c46184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:30Z,use_quota=True,user_id='565997e01eb24bd792a1b12c9fc12917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8306463a-79dd-4037-84b9-04a1a88b9191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8306463a-79dd-4037-84b9-04a1a88b9191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28612846-2048-4de5-bd19-386c4ce0c466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28612846-2048-4de5-bd19-386c4ce0c466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84c795f3-1585-48e6-a563-71cda8ca8bed', 'volume_name': 'volume-84c795f3-1585-48e6-a563-71cda8ca8bed', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dbf3a4e-e4d1-4afb-9143-7a90177d9ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dbf3a4e-e4d1-4afb-9143-7a90177d9ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ce23cd-cc22-4e85-acea-5607dd4f6fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:30 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Volume 84c795f3-1585-48e6-a563-71cda8ca8bed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84c795f3-1585-48e6-a563-71cda8ca8bed', 'volume_size': 1} Jul 14 13:05:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:30 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 Jul 14 13:05:30 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:30 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-c75b3eff-6e17-4445-a653-a51de18c3053 req-97745056-d405-421f-937e-38c04dca323d tempest-TestShelveInstance-713317852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9" returned: 0 in 0.492s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-c75b3eff-6e17-4445-a653-a51de18c3053 req-97745056-d405-421f-937e-38c04dca323d tempest-TestShelveInstance-713317852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:30 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 Jul 14 13:05:30 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:31 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-c75b3eff-6e17-4445-a653-a51de18c3053 req-97745056-d405-421f-937e-38c04dca323d tempest-TestShelveInstance-713317852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9" returned: 1 in 0.541s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-c75b3eff-6e17-4445-a653-a51de18c3053 req-97745056-d405-421f-937e-38c04dca323d tempest-TestShelveInstance-713317852 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:05:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-c75b3eff-6e17-4445-a653-a51de18c3053 req-97745056-d405-421f-937e-38c04dca323d tempest-TestShelveInstance-713317852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.102s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.865s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:31 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-505876885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c795f3-1585-48e6-a563-71cda8ca8bed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629b7355b5d64d0aa640698a15c46184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:30Z,use_quota=True,user_id='565997e01eb24bd792a1b12c9fc12917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:05:31 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Creating volume 84c795f3-1585-48e6-a563-71cda8ca8bed {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:05:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:31 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:31 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:31 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:05:31 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:05:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-84c795f3-1585-48e6-a563-71cda8ca8bed 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:31 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-84c795f3-1585-48e6-a563-71cda8ca8bed 1073741824 Jul 14 13:05:31 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:31 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-c75b3eff-6e17-4445-a653-a51de18c3053 req-97745056-d405-421f-937e-38c04dca323d tempest-TestShelveInstance-713317852 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1', 'name': 'volume-c3d28844-92fd-471c-9625-788625ed95c9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a04b597-d7a7-4be7-acc4-5b71d0c728ee', 'enforce_multipath': True} {{(pid=86977) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 13:05:31 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-c75b3eff-6e17-4445-a653-a51de18c3053 req-97745056-d405-421f-937e-38c04dca323d tempest-TestShelveInstance-713317852 None] attachment_update completed successfully. Jul 14 13:05:31 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-84c795f3-1585-48e6-a563-71cda8ca8bed 1073741824" returned: 0 in 0.560s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-84c795f3-1585-48e6-a563-71cda8ca8bed {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:31 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-84c795f3-1585-48e6-a563-71cda8ca8bed Jul 14 13:05:31 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:32 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-84c795f3-1585-48e6-a563-71cda8ca8bed" returned: 0 in 0.314s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:32 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:05:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ce23cd-cc22-4e85-acea-5607dd4f6fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84c795f3-1585-48e6-a563-71cda8ca8bed', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13cdd6fd-ef9c-4433-953a-f5134f30eeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:32 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Volume volume-84c795f3-1585-48e6-a563-71cda8ca8bed (84c795f3-1585-48e6-a563-71cda8ca8bed): created successfully Jul 14 13:05:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13cdd6fd-ef9c-4433-953a-f5134f30eeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Flow 'volume_create_manager' (0cf1aae8-9650-486e-a655-affd822dde6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:32 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-8eb28382-75a4-4d4a-a0c5-75753654fa6b tempest-VolumesActionsTest-1043955423 None] Created volume successfully. Jul 14 13:05:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bbe1c231-2b18-458c-911c-cdbfe8c3ef79 tempest-VolumesActionsTest-1708452664 None] Acquiring lock "cinder-84c795f3-1585-48e6-a563-71cda8ca8bed-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bbe1c231-2b18-458c-911c-cdbfe8c3ef79 tempest-VolumesActionsTest-1708452664 None] Lock "cinder-84c795f3-1585-48e6-a563-71cda8ca8bed-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bbe1c231-2b18-458c-911c-cdbfe8c3ef79 tempest-VolumesActionsTest-1708452664 None] Acquiring lock "cinder-quobyte-84c795f3-1585-48e6-a563-71cda8ca8bed" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bbe1c231-2b18-458c-911c-cdbfe8c3ef79 tempest-VolumesActionsTest-1708452664 None] Lock "cinder-quobyte-84c795f3-1585-48e6-a563-71cda8ca8bed" acquired by "delete_volume" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:32 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc0ffcd-6c4c-4c12-b0b2-9fe8964cf069]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:05:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bbe1c231-2b18-458c-911c-cdbfe8c3ef79 tempest-VolumesActionsTest-1708452664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-84c795f3-1585-48e6-a563-71cda8ca8bed {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:32 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-84c795f3-1585-48e6-a563-71cda8ca8bed Jul 14 13:05:32 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:33 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bbe1c231-2b18-458c-911c-cdbfe8c3ef79 tempest-VolumesActionsTest-1708452664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-84c795f3-1585-48e6-a563-71cda8ca8bed" returned: 0 in 0.440s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bbe1c231-2b18-458c-911c-cdbfe8c3ef79 tempest-VolumesActionsTest-1708452664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-84c795f3-1585-48e6-a563-71cda8ca8bed {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:33 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-84c795f3-1585-48e6-a563-71cda8ca8bed Jul 14 13:05:33 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:33 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bbe1c231-2b18-458c-911c-cdbfe8c3ef79 tempest-VolumesActionsTest-1708452664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-84c795f3-1585-48e6-a563-71cda8ca8bed" returned: 0 in 0.410s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bbe1c231-2b18-458c-911c-cdbfe8c3ef79 tempest-VolumesActionsTest-1708452664 None] Lock "cinder-quobyte-84c795f3-1585-48e6-a563-71cda8ca8bed" released by "delete_volume" :: held 0.919s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:33 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-bbe1c231-2b18-458c-911c-cdbfe8c3ef79 tempest-VolumesActionsTest-1708452664 None] Created reservations ['9ee7d3a7-8b49-46a0-bd0a-100f650c5512', 'c7442d0f-e13f-461f-b98c-0414fae2f2ca', '07beb9db-079a-49d3-a630-31141021ee45', 'eaf4dda5-e80e-4d7d-839c-6125afb963ff'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:05:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bbe1c231-2b18-458c-911c-cdbfe8c3ef79 tempest-VolumesActionsTest-1708452664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bbe1c231-2b18-458c-911c-cdbfe8c3ef79 tempest-VolumesActionsTest-1708452664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-bbe1c231-2b18-458c-911c-cdbfe8c3ef79 tempest-VolumesActionsTest-1708452664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-bbe1c231-2b18-458c-911c-cdbfe8c3ef79 tempest-VolumesActionsTest-1708452664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bbe1c231-2b18-458c-911c-cdbfe8c3ef79 tempest-VolumesActionsTest-1708452664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bbe1c231-2b18-458c-911c-cdbfe8c3ef79 tempest-VolumesActionsTest-1708452664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:33 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:05:33 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:34 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bbe1c231-2b18-458c-911c-cdbfe8c3ef79 tempest-VolumesActionsTest-1708452664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.428s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-bbe1c231-2b18-458c-911c-cdbfe8c3ef79 tempest-VolumesActionsTest-1708452664 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:05:34 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-bbe1c231-2b18-458c-911c-cdbfe8c3ef79 tempest-VolumesActionsTest-1708452664 None] Deleted volume successfully. Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bbe1c231-2b18-458c-911c-cdbfe8c3ef79 tempest-VolumesActionsTest-1708452664 None] Lock "cinder-84c795f3-1585-48e6-a563-71cda8ca8bed-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Flow 'volume_create_manager' (38cf86d3-7b3a-4229-9e74-c11ee4b166d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f40f73-d04f-43e4-8b29-bcbf63074608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f40f73-d04f-43e4-8b29-bcbf63074608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-323451614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a15a54-ad96-45ae-81b9-369327c54606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f757877a48e340e8b3a77e72ed9f1cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:35Z,use_quota=True,user_id='0d814a81b6484111a01fc9af300f9267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661f77ff-45bc-433f-b923-68001b39f980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661f77ff-45bc-433f-b923-68001b39f980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0319af-f76a-4fac-9b08-870c37e1ae29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0319af-f76a-4fac-9b08-870c37e1ae29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9a15a54-ad96-45ae-81b9-369327c54606', 'volume_name': 'volume-e9a15a54-ad96-45ae-81b9-369327c54606', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e40052b-5ad5-48a2-b4c2-3198800da5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e40052b-5ad5-48a2-b4c2-3198800da5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3491040-d5ff-480d-829d-0948ee776936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:34 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Volume e9a15a54-ad96-45ae-81b9-369327c54606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9a15a54-ad96-45ae-81b9-369327c54606', 'volume_size': 1} Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-323451614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a15a54-ad96-45ae-81b9-369327c54606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f757877a48e340e8b3a77e72ed9f1cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:35Z,use_quota=True,user_id='0d814a81b6484111a01fc9af300f9267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Creating volume e9a15a54-ad96-45ae-81b9-369327c54606 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:05:34 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:05:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e9a15a54-ad96-45ae-81b9-369327c54606 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:34 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e9a15a54-ad96-45ae-81b9-369327c54606 1073741824 Jul 14 13:05:34 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:35 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e9a15a54-ad96-45ae-81b9-369327c54606 1073741824" returned: 0 in 0.733s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e9a15a54-ad96-45ae-81b9-369327c54606 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:35 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e9a15a54-ad96-45ae-81b9-369327c54606 Jul 14 13:05:35 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Flow 'volume_create_manager' (542b12c6-d975-4ceb-8a59-d8fbba463195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b051a7f-7e56-4195-bcda-f250f1850f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b051a7f-7e56-4195-bcda-f250f1850f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-255970158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec2fee19-f6c3-46d2-9757-ea62fe798bab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629b7355b5d64d0aa640698a15c46184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:36Z,use_quota=True,user_id='565997e01eb24bd792a1b12c9fc12917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9e20db-b2e9-4492-bfa5-51418e38b627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9e20db-b2e9-4492-bfa5-51418e38b627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f92550-8592-4dd4-be1e-f28d7a7cfe0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f92550-8592-4dd4-be1e-f28d7a7cfe0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec2fee19-f6c3-46d2-9757-ea62fe798bab', 'volume_name': 'volume-ec2fee19-f6c3-46d2-9757-ea62fe798bab', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a771df-cc21-4575-9d12-836945510b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a771df-cc21-4575-9d12-836945510b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a94bcb-c8db-4baf-ace5-ea09621d65b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:35 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Volume ec2fee19-f6c3-46d2-9757-ea62fe798bab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec2fee19-f6c3-46d2-9757-ea62fe798bab', 'volume_size': 1} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:35 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e9a15a54-ad96-45ae-81b9-369327c54606" returned: 0 in 0.323s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.078s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-255970158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec2fee19-f6c3-46d2-9757-ea62fe798bab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629b7355b5d64d0aa640698a15c46184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:36Z,use_quota=True,user_id='565997e01eb24bd792a1b12c9fc12917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Creating volume ec2fee19-f6c3-46d2-9757-ea62fe798bab {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:05:35 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec2fee19-f6c3-46d2-9757-ea62fe798bab 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:35 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec2fee19-f6c3-46d2-9757-ea62fe798bab 1073741824 Jul 14 13:05:35 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3491040-d5ff-480d-829d-0948ee776936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9a15a54-ad96-45ae-81b9-369327c54606', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc47f44-7c93-4978-8194-3f085eba6d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:35 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Volume volume-e9a15a54-ad96-45ae-81b9-369327c54606 (e9a15a54-ad96-45ae-81b9-369327c54606): created successfully Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc47f44-7c93-4978-8194-3f085eba6d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Flow 'volume_create_manager' (38cf86d3-7b3a-4229-9e74-c11ee4b166d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:35 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-af7a04b5-364a-4ba5-ae57-0cb93d13091b tempest-VolumesTransfersV355Test-114702874 None] Created volume successfully. Jul 14 13:05:36 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec2fee19-f6c3-46d2-9757-ea62fe798bab 1073741824" returned: 0 in 0.485s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec2fee19-f6c3-46d2-9757-ea62fe798bab {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:36 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec2fee19-f6c3-46d2-9757-ea62fe798bab Jul 14 13:05:36 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:36 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec2fee19-f6c3-46d2-9757-ea62fe798bab" returned: 0 in 0.401s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:05:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a94bcb-c8db-4baf-ace5-ea09621d65b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec2fee19-f6c3-46d2-9757-ea62fe798bab', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73583d71-50fb-4d08-a66c-2bef0494aada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:36 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Volume volume-ec2fee19-f6c3-46d2-9757-ea62fe798bab (ec2fee19-f6c3-46d2-9757-ea62fe798bab): created successfully Jul 14 13:05:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73583d71-50fb-4d08-a66c-2bef0494aada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Flow 'volume_create_manager' (542b12c6-d975-4ceb-8a59-d8fbba463195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:36 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-6a1057f3-26f1-4e72-b4d5-71dd680ec8d2 tempest-VolumesActionsTest-1043955423 None] Created volume successfully. Jul 14 13:05:37 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-aa224c87-89ce-47e1-a78e-1076e351fa08 tempest-VolumesTransfersV355Test-1940723311 None] Transfer volume completed successfully. Jul 14 13:05:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d7b568da-5ccc-488e-93d4-5e55b98142f3 tempest-VolumesTransfersV355Test-1226738893 None] Acquiring lock "cinder-e9a15a54-ad96-45ae-81b9-369327c54606-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d7b568da-5ccc-488e-93d4-5e55b98142f3 tempest-VolumesTransfersV355Test-1226738893 None] Lock "cinder-e9a15a54-ad96-45ae-81b9-369327c54606-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d7b568da-5ccc-488e-93d4-5e55b98142f3 tempest-VolumesTransfersV355Test-1226738893 None] Acquiring lock "cinder-quobyte-e9a15a54-ad96-45ae-81b9-369327c54606" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d7b568da-5ccc-488e-93d4-5e55b98142f3 tempest-VolumesTransfersV355Test-1226738893 None] Lock "cinder-quobyte-e9a15a54-ad96-45ae-81b9-369327c54606" acquired by "delete_volume" :: waited 0.025s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:38 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f963da-b86e-496a-8fe4-d0331722a794]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:05:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d7b568da-5ccc-488e-93d4-5e55b98142f3 tempest-VolumesTransfersV355Test-1226738893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e9a15a54-ad96-45ae-81b9-369327c54606 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:38 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e9a15a54-ad96-45ae-81b9-369327c54606 Jul 14 13:05:38 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0c69cc7f-ab0e-4e75-97be-8edb0d724af5 tempest-VolumesActionsTest-1043955423 None] Acquiring lock "cinder-ec2fee19-f6c3-46d2-9757-ea62fe798bab-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0c69cc7f-ab0e-4e75-97be-8edb0d724af5 tempest-VolumesActionsTest-1043955423 None] Lock "cinder-ec2fee19-f6c3-46d2-9757-ea62fe798bab-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0c69cc7f-ab0e-4e75-97be-8edb0d724af5 tempest-VolumesActionsTest-1043955423 None] Acquiring lock "cinder-quobyte-ec2fee19-f6c3-46d2-9757-ea62fe798bab" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0c69cc7f-ab0e-4e75-97be-8edb0d724af5 tempest-VolumesActionsTest-1043955423 None] Lock "cinder-quobyte-ec2fee19-f6c3-46d2-9757-ea62fe798bab" acquired by "delete_volume" :: waited 0.025s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:38 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca73eca9-bf2c-4dc6-a09f-a6a5b397b65c]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:05:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0c69cc7f-ab0e-4e75-97be-8edb0d724af5 tempest-VolumesActionsTest-1043955423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec2fee19-f6c3-46d2-9757-ea62fe798bab {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:38 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d7b568da-5ccc-488e-93d4-5e55b98142f3 tempest-VolumesTransfersV355Test-1226738893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e9a15a54-ad96-45ae-81b9-369327c54606" returned: 0 in 0.525s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d7b568da-5ccc-488e-93d4-5e55b98142f3 tempest-VolumesTransfersV355Test-1226738893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e9a15a54-ad96-45ae-81b9-369327c54606 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:38 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e9a15a54-ad96-45ae-81b9-369327c54606 Jul 14 13:05:38 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:39 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec2fee19-f6c3-46d2-9757-ea62fe798bab Jul 14 13:05:39 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:39 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d7b568da-5ccc-488e-93d4-5e55b98142f3 tempest-VolumesTransfersV355Test-1226738893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e9a15a54-ad96-45ae-81b9-369327c54606" returned: 0 in 0.339s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d7b568da-5ccc-488e-93d4-5e55b98142f3 tempest-VolumesTransfersV355Test-1226738893 None] Lock "cinder-quobyte-e9a15a54-ad96-45ae-81b9-369327c54606" released by "delete_volume" :: held 0.980s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:39 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-d7b568da-5ccc-488e-93d4-5e55b98142f3 tempest-VolumesTransfersV355Test-1226738893 None] Created reservations ['a271c831-a629-4010-a60b-bda5663aa0a3', '5503b9c7-9ed0-42ab-a4d3-75fab8a36b23', 'fb7f41ca-eff0-4d9e-9361-9af400f246e3', 'a281dc65-b7d8-4596-8132-50e844e8e716'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:05:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d7b568da-5ccc-488e-93d4-5e55b98142f3 tempest-VolumesTransfersV355Test-1226738893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d7b568da-5ccc-488e-93d4-5e55b98142f3 tempest-VolumesTransfersV355Test-1226738893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:39 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d7b568da-5ccc-488e-93d4-5e55b98142f3 tempest-VolumesTransfersV355Test-1226738893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:39 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d7b568da-5ccc-488e-93d4-5e55b98142f3 tempest-VolumesTransfersV355Test-1226738893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d7b568da-5ccc-488e-93d4-5e55b98142f3 tempest-VolumesTransfersV355Test-1226738893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d7b568da-5ccc-488e-93d4-5e55b98142f3 tempest-VolumesTransfersV355Test-1226738893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:39 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0c69cc7f-ab0e-4e75-97be-8edb0d724af5 tempest-VolumesActionsTest-1043955423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec2fee19-f6c3-46d2-9757-ea62fe798bab" returned: 0 in 0.702s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0c69cc7f-ab0e-4e75-97be-8edb0d724af5 tempest-VolumesActionsTest-1043955423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec2fee19-f6c3-46d2-9757-ea62fe798bab {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:39 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:05:39 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:39 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec2fee19-f6c3-46d2-9757-ea62fe798bab Jul 14 13:05:39 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:39 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0c69cc7f-ab0e-4e75-97be-8edb0d724af5 tempest-VolumesActionsTest-1043955423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec2fee19-f6c3-46d2-9757-ea62fe798bab" returned: 0 in 0.296s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0c69cc7f-ab0e-4e75-97be-8edb0d724af5 tempest-VolumesActionsTest-1043955423 None] Lock "cinder-quobyte-ec2fee19-f6c3-46d2-9757-ea62fe798bab" released by "delete_volume" :: held 1.074s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:39 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d7b568da-5ccc-488e-93d4-5e55b98142f3 tempest-VolumesTransfersV355Test-1226738893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.368s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:39 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-d7b568da-5ccc-488e-93d4-5e55b98142f3 tempest-VolumesTransfersV355Test-1226738893 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:05:40 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-d7b568da-5ccc-488e-93d4-5e55b98142f3 tempest-VolumesTransfersV355Test-1226738893 None] Deleted volume successfully. Jul 14 13:05:40 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d7b568da-5ccc-488e-93d4-5e55b98142f3 tempest-VolumesTransfersV355Test-1226738893 None] Lock "cinder-e9a15a54-ad96-45ae-81b9-369327c54606-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:40 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-0c69cc7f-ab0e-4e75-97be-8edb0d724af5 tempest-VolumesActionsTest-1043955423 None] Created reservations ['0b2c3b3b-152f-48a8-b309-313c8b5991db', 'cf00134b-f470-41ff-baa0-1fb7143738d3', '2b34efe8-4522-4d19-9c69-06bd81e69f64', 'efea97fd-4f6b-45a0-8fb7-d43d9d03f180'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:05:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0c69cc7f-ab0e-4e75-97be-8edb0d724af5 tempest-VolumesActionsTest-1043955423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0c69cc7f-ab0e-4e75-97be-8edb0d724af5 tempest-VolumesActionsTest-1043955423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:40 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0c69cc7f-ab0e-4e75-97be-8edb0d724af5 tempest-VolumesActionsTest-1043955423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:40 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0c69cc7f-ab0e-4e75-97be-8edb0d724af5 tempest-VolumesActionsTest-1043955423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0c69cc7f-ab0e-4e75-97be-8edb0d724af5 tempest-VolumesActionsTest-1043955423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0c69cc7f-ab0e-4e75-97be-8edb0d724af5 tempest-VolumesActionsTest-1043955423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:40 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:05:40 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:40 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0c69cc7f-ab0e-4e75-97be-8edb0d724af5 tempest-VolumesActionsTest-1043955423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.325s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:40 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-0c69cc7f-ab0e-4e75-97be-8edb0d724af5 tempest-VolumesActionsTest-1043955423 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:05:40 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-0c69cc7f-ab0e-4e75-97be-8edb0d724af5 tempest-VolumesActionsTest-1043955423 None] Deleted volume successfully. Jul 14 13:05:40 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0c69cc7f-ab0e-4e75-97be-8edb0d724af5 tempest-VolumesActionsTest-1043955423 None] Lock "cinder-ec2fee19-f6c3-46d2-9757-ea62fe798bab-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Flow 'volume_create_manager' (40e6885e-25fa-4485-91fe-fdd85340936a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6aec7e-dc3b-4c8c-9b23-debfbad349a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6aec7e-dc3b-4c8c-9b23-debfbad349a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1260064504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f74b5cb-5354-4a0d-b790-626495d487af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f757877a48e340e8b3a77e72ed9f1cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:41Z,use_quota=True,user_id='0d814a81b6484111a01fc9af300f9267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dfeba0b-3da5-4c2f-bcde-e55a09fce627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dfeba0b-3da5-4c2f-bcde-e55a09fce627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e50557d-28f6-4968-9c7c-297e0531be40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e50557d-28f6-4968-9c7c-297e0531be40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f74b5cb-5354-4a0d-b790-626495d487af', 'volume_name': 'volume-6f74b5cb-5354-4a0d-b790-626495d487af', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (844c2c47-38ce-4c81-8a24-ad7708ed882b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (844c2c47-38ce-4c81-8a24-ad7708ed882b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190e41a3-1c50-4fec-b686-5eac43681612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:41 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Volume 6f74b5cb-5354-4a0d-b790-626495d487af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f74b5cb-5354-4a0d-b790-626495d487af', 'volume_size': 1} Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1260064504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f74b5cb-5354-4a0d-b790-626495d487af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f757877a48e340e8b3a77e72ed9f1cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:41Z,use_quota=True,user_id='0d814a81b6484111a01fc9af300f9267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Creating volume 6f74b5cb-5354-4a0d-b790-626495d487af {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:05:41 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6f74b5cb-5354-4a0d-b790-626495d487af 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:41 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6f74b5cb-5354-4a0d-b790-626495d487af 1073741824 Jul 14 13:05:41 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:41 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6f74b5cb-5354-4a0d-b790-626495d487af 1073741824" returned: 0 in 0.506s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6f74b5cb-5354-4a0d-b790-626495d487af {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:42 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6f74b5cb-5354-4a0d-b790-626495d487af Jul 14 13:05:42 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:42 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6f74b5cb-5354-4a0d-b790-626495d487af" returned: 0 in 0.275s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:42 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:05:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190e41a3-1c50-4fec-b686-5eac43681612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f74b5cb-5354-4a0d-b790-626495d487af', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec27c676-d1fb-4198-adb9-2f0c8e4e1dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:42 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Volume volume-6f74b5cb-5354-4a0d-b790-626495d487af (6f74b5cb-5354-4a0d-b790-626495d487af): created successfully Jul 14 13:05:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec27c676-d1fb-4198-adb9-2f0c8e4e1dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Flow 'volume_create_manager' (40e6885e-25fa-4485-91fe-fdd85340936a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:42 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-8eea6b93-965e-414c-a314-a24649dc49f9 tempest-VolumesTransfersV355Test-114702874 None] Created volume successfully. Jul 14 13:05:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5535704-4646-4ca4-a2b8-0a6b9a2e3acc tempest-VolumesTransfersV355Test-1226738893 None] Acquiring lock "cinder-6f74b5cb-5354-4a0d-b790-626495d487af-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5535704-4646-4ca4-a2b8-0a6b9a2e3acc tempest-VolumesTransfersV355Test-1226738893 None] Lock "cinder-6f74b5cb-5354-4a0d-b790-626495d487af-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:44 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5535704-4646-4ca4-a2b8-0a6b9a2e3acc tempest-VolumesTransfersV355Test-1226738893 None] Acquiring lock "cinder-quobyte-6f74b5cb-5354-4a0d-b790-626495d487af" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:44 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5535704-4646-4ca4-a2b8-0a6b9a2e3acc tempest-VolumesTransfersV355Test-1226738893 None] Lock "cinder-quobyte-6f74b5cb-5354-4a0d-b790-626495d487af" acquired by "delete_volume" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:44 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e1d5fb-8295-4cc2-9326-fe841e33d9e3]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:05:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5535704-4646-4ca4-a2b8-0a6b9a2e3acc tempest-VolumesTransfersV355Test-1226738893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6f74b5cb-5354-4a0d-b790-626495d487af {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:44 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6f74b5cb-5354-4a0d-b790-626495d487af Jul 14 13:05:44 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:44 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5535704-4646-4ca4-a2b8-0a6b9a2e3acc tempest-VolumesTransfersV355Test-1226738893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6f74b5cb-5354-4a0d-b790-626495d487af" returned: 0 in 0.403s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5535704-4646-4ca4-a2b8-0a6b9a2e3acc tempest-VolumesTransfersV355Test-1226738893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6f74b5cb-5354-4a0d-b790-626495d487af {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:44 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6f74b5cb-5354-4a0d-b790-626495d487af Jul 14 13:05:44 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:44 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5535704-4646-4ca4-a2b8-0a6b9a2e3acc tempest-VolumesTransfersV355Test-1226738893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6f74b5cb-5354-4a0d-b790-626495d487af" returned: 0 in 0.302s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:44 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5535704-4646-4ca4-a2b8-0a6b9a2e3acc tempest-VolumesTransfersV355Test-1226738893 None] Lock "cinder-quobyte-6f74b5cb-5354-4a0d-b790-626495d487af" released by "delete_volume" :: held 0.779s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:44 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-b5535704-4646-4ca4-a2b8-0a6b9a2e3acc tempest-VolumesTransfersV355Test-1226738893 None] Created reservations ['7825f9c6-0f7f-488b-a1dc-b817be29ad9c', '3025aedc-2ff8-4a7c-919b-516ed9a67205', '78521a21-3359-4cb3-9256-706feabb6477', '3d249dea-f09d-4c3a-bb9f-000035538cd0'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:05:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b5535704-4646-4ca4-a2b8-0a6b9a2e3acc tempest-VolumesTransfersV355Test-1226738893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b5535704-4646-4ca4-a2b8-0a6b9a2e3acc tempest-VolumesTransfersV355Test-1226738893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:45 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b5535704-4646-4ca4-a2b8-0a6b9a2e3acc tempest-VolumesTransfersV355Test-1226738893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:45 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b5535704-4646-4ca4-a2b8-0a6b9a2e3acc tempest-VolumesTransfersV355Test-1226738893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b5535704-4646-4ca4-a2b8-0a6b9a2e3acc tempest-VolumesTransfersV355Test-1226738893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5535704-4646-4ca4-a2b8-0a6b9a2e3acc tempest-VolumesTransfersV355Test-1226738893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:45 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:05:45 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:45 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5535704-4646-4ca4-a2b8-0a6b9a2e3acc tempest-VolumesTransfersV355Test-1226738893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.337s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:45 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-b5535704-4646-4ca4-a2b8-0a6b9a2e3acc tempest-VolumesTransfersV355Test-1226738893 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:05:45 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b5535704-4646-4ca4-a2b8-0a6b9a2e3acc tempest-VolumesTransfersV355Test-1226738893 None] Deleted volume successfully. Jul 14 13:05:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5535704-4646-4ca4-a2b8-0a6b9a2e3acc tempest-VolumesTransfersV355Test-1226738893 None] Lock "cinder-6f74b5cb-5354-4a0d-b790-626495d487af-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Flow 'volume_create_manager' (a31b44e2-1d7e-41c1-b4c0-a370fcdb1f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b226203a-8ee8-4b18-aeb6-38c24daaf47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b226203a-8ee8-4b18-aeb6-38c24daaf47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-476181999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a21c35-e8f3-4a42-a8ec-246edce4f21d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb96d5bacd6420b92827e69c4d2ae17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:52Z,use_quota=True,user_id='b3894ff970b24f8a99f88af55ee9bbc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f863863f-6d13-427f-bf1c-9542d2bd4461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f863863f-6d13-427f-bf1c-9542d2bd4461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9eb53e-dbed-4d4f-aff6-af6c036269a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9eb53e-dbed-4d4f-aff6-af6c036269a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2a21c35-e8f3-4a42-a8ec-246edce4f21d', 'volume_name': 'volume-b2a21c35-e8f3-4a42-a8ec-246edce4f21d', 'volume_size': 2}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8112e8bb-7f33-4a07-8d65-33f706b2368f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8112e8bb-7f33-4a07-8d65-33f706b2368f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57eec3e0-ce24-45db-97a5-4fa299db6bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:52 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Volume b2a21c35-e8f3-4a42-a8ec-246edce4f21d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2a21c35-e8f3-4a42-a8ec-246edce4f21d', 'volume_size': 2} Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-476181999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a21c35-e8f3-4a42-a8ec-246edce4f21d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb96d5bacd6420b92827e69c4d2ae17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:52Z,use_quota=True,user_id='b3894ff970b24f8a99f88af55ee9bbc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Creating volume b2a21c35-e8f3-4a42-a8ec-246edce4f21d {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:05:52 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2a21c35-e8f3-4a42-a8ec-246edce4f21d 2147483648 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:52 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2a21c35-e8f3-4a42-a8ec-246edce4f21d 2147483648 Jul 14 13:05:52 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:52 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2a21c35-e8f3-4a42-a8ec-246edce4f21d 2147483648" returned: 0 in 0.488s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2a21c35-e8f3-4a42-a8ec-246edce4f21d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:53 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2a21c35-e8f3-4a42-a8ec-246edce4f21d Jul 14 13:05:53 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:53 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2a21c35-e8f3-4a42-a8ec-246edce4f21d" returned: 0 in 0.254s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:53 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:05:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57eec3e0-ce24-45db-97a5-4fa299db6bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a21c35-e8f3-4a42-a8ec-246edce4f21d', 'volume_size': 2}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bca1a23-6ecd-492c-b64b-f44f161010de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:53 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Volume volume-b2a21c35-e8f3-4a42-a8ec-246edce4f21d (b2a21c35-e8f3-4a42-a8ec-246edce4f21d): created successfully Jul 14 13:05:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bca1a23-6ecd-492c-b64b-f44f161010de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Flow 'volume_create_manager' (a31b44e2-1d7e-41c1-b4c0-a370fcdb1f39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:53 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-26b48d10-f553-4997-96c0-4dd3f464600c tempest-VolumesCloneNegativeTest-1414533334 None] Created volume successfully. Jul 14 13:05:53 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fdc31802-4fea-45da-abd0-13539c59f4b2 tempest-VolumesCloneNegativeTest-1414533334 None] Acquiring lock "cinder-b2a21c35-e8f3-4a42-a8ec-246edce4f21d-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:53 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fdc31802-4fea-45da-abd0-13539c59f4b2 tempest-VolumesCloneNegativeTest-1414533334 None] Lock "cinder-b2a21c35-e8f3-4a42-a8ec-246edce4f21d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:53 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fdc31802-4fea-45da-abd0-13539c59f4b2 tempest-VolumesCloneNegativeTest-1414533334 None] Acquiring lock "cinder-quobyte-b2a21c35-e8f3-4a42-a8ec-246edce4f21d" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:53 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fdc31802-4fea-45da-abd0-13539c59f4b2 tempest-VolumesCloneNegativeTest-1414533334 None] Lock "cinder-quobyte-b2a21c35-e8f3-4a42-a8ec-246edce4f21d" acquired by "delete_volume" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:53 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94861ee-f5cc-471a-9f23-8d6683a4daa1]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:05:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fdc31802-4fea-45da-abd0-13539c59f4b2 tempest-VolumesCloneNegativeTest-1414533334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2a21c35-e8f3-4a42-a8ec-246edce4f21d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:54 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2a21c35-e8f3-4a42-a8ec-246edce4f21d Jul 14 13:05:54 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:54 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fdc31802-4fea-45da-abd0-13539c59f4b2 tempest-VolumesCloneNegativeTest-1414533334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2a21c35-e8f3-4a42-a8ec-246edce4f21d" returned: 0 in 0.379s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fdc31802-4fea-45da-abd0-13539c59f4b2 tempest-VolumesCloneNegativeTest-1414533334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2a21c35-e8f3-4a42-a8ec-246edce4f21d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:54 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2a21c35-e8f3-4a42-a8ec-246edce4f21d Jul 14 13:05:54 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:54 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fdc31802-4fea-45da-abd0-13539c59f4b2 tempest-VolumesCloneNegativeTest-1414533334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2a21c35-e8f3-4a42-a8ec-246edce4f21d" returned: 0 in 0.271s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:54 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fdc31802-4fea-45da-abd0-13539c59f4b2 tempest-VolumesCloneNegativeTest-1414533334 None] Lock "cinder-quobyte-b2a21c35-e8f3-4a42-a8ec-246edce4f21d" released by "delete_volume" :: held 0.689s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:54 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-fdc31802-4fea-45da-abd0-13539c59f4b2 tempest-VolumesCloneNegativeTest-1414533334 None] Created reservations ['1eac083f-20c1-4433-8420-447534ba6ae1', 'be2333a1-9545-42cc-aacd-0f9f10312c42', 'd81b0491-6780-42a3-9044-ceec4e562dce', 'a3f6dbb2-e792-4a7d-86ea-ce555dafebaa'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:05:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fdc31802-4fea-45da-abd0-13539c59f4b2 tempest-VolumesCloneNegativeTest-1414533334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fdc31802-4fea-45da-abd0-13539c59f4b2 tempest-VolumesCloneNegativeTest-1414533334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:54 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fdc31802-4fea-45da-abd0-13539c59f4b2 tempest-VolumesCloneNegativeTest-1414533334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:54 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fdc31802-4fea-45da-abd0-13539c59f4b2 tempest-VolumesCloneNegativeTest-1414533334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fdc31802-4fea-45da-abd0-13539c59f4b2 tempest-VolumesCloneNegativeTest-1414533334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fdc31802-4fea-45da-abd0-13539c59f4b2 tempest-VolumesCloneNegativeTest-1414533334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:54 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:05:54 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:54 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fdc31802-4fea-45da-abd0-13539c59f4b2 tempest-VolumesCloneNegativeTest-1414533334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.254s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:54 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-fdc31802-4fea-45da-abd0-13539c59f4b2 tempest-VolumesCloneNegativeTest-1414533334 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:05:54 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-fdc31802-4fea-45da-abd0-13539c59f4b2 tempest-VolumesCloneNegativeTest-1414533334 None] Deleted volume successfully. Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fdc31802-4fea-45da-abd0-13539c59f4b2 tempest-VolumesCloneNegativeTest-1414533334 None] Lock "cinder-b2a21c35-e8f3-4a42-a8ec-246edce4f21d-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Flow 'volume_create_manager' (162be4d4-75f9-48bd-a8d7-0f33262d48a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e97879-d1ef-4330-b25c-0d1956bade61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e97879-d1ef-4330-b25c-0d1956bade61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-727769633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f317601380c94a84a17ddacc499790fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:55Z,use_quota=True,user_id='78acbdbd63b84b5ebb922f10d28ec63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fc0c56f-3cfc-4e49-83df-3497e19652f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fc0c56f-3cfc-4e49-83df-3497e19652f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef0772b-530b-4027-982e-fde7ceb9727f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef0772b-530b-4027-982e-fde7ceb9727f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a', 'volume_name': 'volume-7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3492af46-72d6-4ff6-bae8-52852d29696e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3492af46-72d6-4ff6-bae8-52852d29696e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1381eb66-6d5f-4162-935c-7b71d0f60527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:55 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Volume 7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a', 'volume_size': 1} Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-727769633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f317601380c94a84a17ddacc499790fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:55Z,use_quota=True,user_id='78acbdbd63b84b5ebb922f10d28ec63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Creating volume 7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:05:55 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:05:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:55 devstack sudo[98712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a 1073741824 Jul 14 13:05:55 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:56 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a 1073741824" returned: 0 in 0.478s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:56 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a Jul 14 13:05:56 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:56 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a" returned: 0 in 0.271s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:05:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1381eb66-6d5f-4162-935c-7b71d0f60527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22df7fbe-b66d-4050-8ed3-46a3a27b636a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:56 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Volume volume-7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a (7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a): created successfully Jul 14 13:05:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22df7fbe-b66d-4050-8ed3-46a3a27b636a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Flow 'volume_create_manager' (162be4d4-75f9-48bd-a8d7-0f33262d48a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:56 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-9821d2b2-0ade-42b6-9fc5-f8ac7b63fb03 tempest-VolumesMetadataTest-649730827 None] Created volume successfully. Jul 14 13:05:57 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:05:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Flow 'volume_create_manager' (9a7360ff-1ed7-4235-99ce-4a9b21bb9b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932ff1c3-bce3-4adb-9fc5-3ed23a9a3e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932ff1c3-bce3-4adb-9fc5-3ed23a9a3e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1740015918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=092fa53e-ddbc-418f-8c48-d02727650684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90cc05027ca14cba925c428840267e98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:58Z,use_quota=True,user_id='303e4cacce794cbaa69fa021c96925d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bdc8105-7b78-4dfa-aa85-a5c0b7a6fe02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bdc8105-7b78-4dfa-aa85-a5c0b7a6fe02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (611b12ca-36a2-423a-a695-1697334d1429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (611b12ca-36a2-423a-a695-1697334d1429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '092fa53e-ddbc-418f-8c48-d02727650684', 'volume_name': 'volume-092fa53e-ddbc-418f-8c48-d02727650684', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c82613a-f962-4352-8183-cb5c5b711b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c82613a-f962-4352-8183-cb5c5b711b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f44f5174-0797-496f-9ef4-20a36e3a6826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:57 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Volume 092fa53e-ddbc-418f-8c48-d02727650684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-092fa53e-ddbc-418f-8c48-d02727650684', 'volume_size': 1} Jul 14 13:05:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1740015918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=092fa53e-ddbc-418f-8c48-d02727650684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90cc05027ca14cba925c428840267e98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:05:58Z,use_quota=True,user_id='303e4cacce794cbaa69fa021c96925d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:05:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Creating volume 092fa53e-ddbc-418f-8c48-d02727650684 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:05:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:05:57 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:05:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-092fa53e-ddbc-418f-8c48-d02727650684 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:57 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-092fa53e-ddbc-418f-8c48-d02727650684 1073741824 Jul 14 13:05:57 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-25e30e83-4093-4132-adde-993f1f6aa84b tempest-VolumesMetadataTest-649730827 None] Acquiring lock "cinder-7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-25e30e83-4093-4132-adde-993f1f6aa84b tempest-VolumesMetadataTest-649730827 None] Lock "cinder-7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-25e30e83-4093-4132-adde-993f1f6aa84b tempest-VolumesMetadataTest-649730827 None] Acquiring lock "cinder-quobyte-7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:05:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-25e30e83-4093-4132-adde-993f1f6aa84b tempest-VolumesMetadataTest-649730827 None] Lock "cinder-quobyte-7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a" acquired by "delete_volume" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:05:58 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cf3fc0-149c-4dfe-9153-fe944fc98124]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:05:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-25e30e83-4093-4132-adde-993f1f6aa84b tempest-VolumesMetadataTest-649730827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:58 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-092fa53e-ddbc-418f-8c48-d02727650684 1073741824" returned: 0 in 0.563s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:58 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=107,cinder:UPDATE=171,cinder:INSERT=43,cinder:DELETE=17 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:05:58 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a Jul 14 13:05:58 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-092fa53e-ddbc-418f-8c48-d02727650684 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:58 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-092fa53e-ddbc-418f-8c48-d02727650684 Jul 14 13:05:58 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:58 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-25e30e83-4093-4132-adde-993f1f6aa84b tempest-VolumesMetadataTest-649730827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a" returned: 0 in 0.404s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-25e30e83-4093-4132-adde-993f1f6aa84b tempest-VolumesMetadataTest-649730827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:58 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-092fa53e-ddbc-418f-8c48-d02727650684" returned: 0 in 0.290s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:05:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:58 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a Jul 14 13:05:58 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f44f5174-0797-496f-9ef4-20a36e3a6826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-092fa53e-ddbc-418f-8c48-d02727650684', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f74155a-2926-4a59-b743-829e2ba6f4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:05:58 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Volume volume-092fa53e-ddbc-418f-8c48-d02727650684 (092fa53e-ddbc-418f-8c48-d02727650684): created successfully Jul 14 13:05:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f74155a-2926-4a59-b743-829e2ba6f4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:05:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Flow 'volume_create_manager' (9a7360ff-1ed7-4235-99ce-4a9b21bb9b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:05:58 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:UPDATE=145,cinder:SELECT=131,cinder:INSERT=40,cinder:DELETE=11 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:05:58 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-73b64d1e-b5ba-47cc-8c2f-d603943191ac tempest-VolumesNegativeTest-2014227815 None] Created volume successfully. Jul 14 13:05:59 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-25e30e83-4093-4132-adde-993f1f6aa84b tempest-VolumesMetadataTest-649730827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a" returned: 0 in 0.277s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:59 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-25e30e83-4093-4132-adde-993f1f6aa84b tempest-VolumesMetadataTest-649730827 None] Lock "cinder-quobyte-7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a" released by "delete_volume" :: held 0.728s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:05:59 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-25e30e83-4093-4132-adde-993f1f6aa84b tempest-VolumesMetadataTest-649730827 None] Created reservations ['1147db06-7ab6-45c3-9652-70df61ce8db5', '220d5790-ddbf-4ed0-b995-733d62589e1e', '0167b2c0-fa2c-435b-b4a3-c9dbc9dc8bc7', '786a47da-720a-4f2f-9680-452cebeb44bc'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:05:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-25e30e83-4093-4132-adde-993f1f6aa84b tempest-VolumesMetadataTest-649730827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:05:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-25e30e83-4093-4132-adde-993f1f6aa84b tempest-VolumesMetadataTest-649730827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:05:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-25e30e83-4093-4132-adde-993f1f6aa84b tempest-VolumesMetadataTest-649730827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:05:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-25e30e83-4093-4132-adde-993f1f6aa84b tempest-VolumesMetadataTest-649730827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:05:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-25e30e83-4093-4132-adde-993f1f6aa84b tempest-VolumesMetadataTest-649730827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:05:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-25e30e83-4093-4132-adde-993f1f6aa84b tempest-VolumesMetadataTest-649730827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:05:59 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:05:59 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:05:59 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Jul 14 13:05:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-25e30e83-4093-4132-adde-993f1f6aa84b tempest-VolumesMetadataTest-649730827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.258s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:05:59 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-25e30e83-4093-4132-adde-993f1f6aa84b tempest-VolumesMetadataTest-649730827 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:05:59 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-25e30e83-4093-4132-adde-993f1f6aa84b tempest-VolumesMetadataTest-649730827 None] Deleted volume successfully. Jul 14 13:05:59 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-25e30e83-4093-4132-adde-993f1f6aa84b tempest-VolumesMetadataTest-649730827 None] Lock "cinder-7ac0291a-2dc8-4b4e-ac7b-d19339d6c88a-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:06:04 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:06:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Flow 'volume_create_manager' (216c917d-cda7-4b6f-85cf-8f8a34756526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:06:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5a546c-bffa-4526-ad86-5eab7fdb5200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5a546c-bffa-4526-ad86-5eab7fdb5200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-841901715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13949cb2-9098-4f62-a60f-c580bea0b06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29b2f97eb3164bc48db2cbb0a210f926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:06:05Z,use_quota=True,user_id='6972711fe3ed4abfb518ff5454c1512c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b19454b3-7fc7-4788-888f-0685db261466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b19454b3-7fc7-4788-888f-0685db261466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d3f62a-032c-43ca-94c1-f5e5afad57a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d3f62a-032c-43ca-94c1-f5e5afad57a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13949cb2-9098-4f62-a60f-c580bea0b06b', 'volume_name': 'volume-13949cb2-9098-4f62-a60f-c580bea0b06b', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e930c3fa-91be-48fc-b192-91ad3bc39a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e930c3fa-91be-48fc-b192-91ad3bc39a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e828c4d7-78e0-47b3-bbc0-7b5f31e8a0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:04 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Volume 13949cb2-9098-4f62-a60f-c580bea0b06b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13949cb2-9098-4f62-a60f-c580bea0b06b', 'volume_size': 1} Jul 14 13:06:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:06:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:06:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-841901715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13949cb2-9098-4f62-a60f-c580bea0b06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29b2f97eb3164bc48db2cbb0a210f926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:06:05Z,use_quota=True,user_id='6972711fe3ed4abfb518ff5454c1512c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:06:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Creating volume 13949cb2-9098-4f62-a60f-c580bea0b06b {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:06:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:06:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:06:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:06:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:06:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:06:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:06:04 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:06:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-13949cb2-9098-4f62-a60f-c580bea0b06b 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:04 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-13949cb2-9098-4f62-a60f-c580bea0b06b 1073741824 Jul 14 13:06:04 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:05 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-13949cb2-9098-4f62-a60f-c580bea0b06b 1073741824" returned: 0 in 0.747s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-13949cb2-9098-4f62-a60f-c580bea0b06b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:05 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-13949cb2-9098-4f62-a60f-c580bea0b06b Jul 14 13:06:05 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:05 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-2158eb29-e17a-453f-8362-aaf51a915257 req-784a6233-1ccb-48ed-9874-b5d89bbd994b tempest-TestShelveInstance-713317852 None] Terminate volume connection completed successfully. Jul 14 13:06:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-2158eb29-e17a-453f-8362-aaf51a915257 req-784a6233-1ccb-48ed-9874-b5d89bbd994b tempest-TestShelveInstance-713317852 None] Deleting attachment 9a04b597-d7a7-4be7-acc4-5b71d0c728ee. {{(pid=86977) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 13:06:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-13949cb2-9098-4f62-a60f-c580bea0b06b" returned: 0 in 0.290s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:06:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:06:06 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e828c4d7-78e0-47b3-bbc0-7b5f31e8a0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13949cb2-9098-4f62-a60f-c580bea0b06b', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abd8d5a1-11e9-478c-9819-1fcbbb441550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:06 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Volume volume-13949cb2-9098-4f62-a60f-c580bea0b06b (13949cb2-9098-4f62-a60f-c580bea0b06b): created successfully Jul 14 13:06:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abd8d5a1-11e9-478c-9819-1fcbbb441550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Flow 'volume_create_manager' (216c917d-cda7-4b6f-85cf-8f8a34756526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:06:06 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-147615e1-f896-4789-aca4-c14b8d4f7dab tempest-VolumesTransfersTest-125053496 None] Created volume successfully. Jul 14 13:06:08 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-44b7a792-837b-4eab-9643-08a0dacf2b23 tempest-VolumesTransfersTest-1838047020 None] Transfer volume completed successfully. Jul 14 13:06:08 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c9587e86-4dcf-4a4a-97de-71d85f311bdd tempest-VolumesTransfersTest-2047213957 None] Acquiring lock "cinder-13949cb2-9098-4f62-a60f-c580bea0b06b-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:06:08 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c9587e86-4dcf-4a4a-97de-71d85f311bdd tempest-VolumesTransfersTest-2047213957 None] Lock "cinder-13949cb2-9098-4f62-a60f-c580bea0b06b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:06:08 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c9587e86-4dcf-4a4a-97de-71d85f311bdd tempest-VolumesTransfersTest-2047213957 None] Acquiring lock "cinder-quobyte-13949cb2-9098-4f62-a60f-c580bea0b06b" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:06:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c9587e86-4dcf-4a4a-97de-71d85f311bdd tempest-VolumesTransfersTest-2047213957 None] Lock "cinder-quobyte-13949cb2-9098-4f62-a60f-c580bea0b06b" acquired by "delete_volume" :: waited 0.024s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:06:09 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2ecd25-0c54-4388-9343-cca8765caec4]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:06:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c9587e86-4dcf-4a4a-97de-71d85f311bdd tempest-VolumesTransfersTest-2047213957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-13949cb2-9098-4f62-a60f-c580bea0b06b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:09 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-13949cb2-9098-4f62-a60f-c580bea0b06b Jul 14 13:06:09 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-262c9b43-a85d-41ec-988e-6ae8b6b2792f req-c78573de-596f-4367-9ee6-f5f6cf9186c7 tempest-TestShelveInstance-713317852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:06:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-262c9b43-a85d-41ec-988e-6ae8b6b2792f req-c78573de-596f-4367-9ee6-f5f6cf9186c7 tempest-TestShelveInstance-713317852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:06:09 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[c844f9c8-0972-4854-8888-dca700bcad99]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:06:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-262c9b43-a85d-41ec-988e-6ae8b6b2792f req-c78573de-596f-4367-9ee6-f5f6cf9186c7 tempest-TestShelveInstance-713317852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:09 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 Jul 14 13:06:09 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:09 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c9587e86-4dcf-4a4a-97de-71d85f311bdd tempest-VolumesTransfersTest-2047213957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-13949cb2-9098-4f62-a60f-c580bea0b06b" returned: 0 in 0.664s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c9587e86-4dcf-4a4a-97de-71d85f311bdd tempest-VolumesTransfersTest-2047213957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-13949cb2-9098-4f62-a60f-c580bea0b06b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:09 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-13949cb2-9098-4f62-a60f-c580bea0b06b Jul 14 13:06:09 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:09 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-262c9b43-a85d-41ec-988e-6ae8b6b2792f req-c78573de-596f-4367-9ee6-f5f6cf9186c7 tempest-TestShelveInstance-713317852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9" returned: 0 in 0.471s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-262c9b43-a85d-41ec-988e-6ae8b6b2792f req-c78573de-596f-4367-9ee6-f5f6cf9186c7 tempest-TestShelveInstance-713317852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:09 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 Jul 14 13:06:09 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:10 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c9587e86-4dcf-4a4a-97de-71d85f311bdd tempest-VolumesTransfersTest-2047213957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-13949cb2-9098-4f62-a60f-c580bea0b06b" returned: 0 in 0.390s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c9587e86-4dcf-4a4a-97de-71d85f311bdd tempest-VolumesTransfersTest-2047213957 None] Lock "cinder-quobyte-13949cb2-9098-4f62-a60f-c580bea0b06b" released by "delete_volume" :: held 1.164s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:06:10 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-c9587e86-4dcf-4a4a-97de-71d85f311bdd tempest-VolumesTransfersTest-2047213957 None] Created reservations ['f6d2aa06-9ff4-4f83-9ee7-134a010bd97d', '5611d9b3-2d04-4512-9859-348daddd7721', 'f9aeaac7-e193-487e-8ce5-e252b4f7c1ee', 'a8e3b9ba-56d2-4b72-91bc-dcea07680d2f'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:06:10 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-262c9b43-a85d-41ec-988e-6ae8b6b2792f req-c78573de-596f-4367-9ee6-f5f6cf9186c7 tempest-TestShelveInstance-713317852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9" returned: 1 in 0.529s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-262c9b43-a85d-41ec-988e-6ae8b6b2792f req-c78573de-596f-4367-9ee6-f5f6cf9186c7 tempest-TestShelveInstance-713317852 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:06:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-262c9b43-a85d-41ec-988e-6ae8b6b2792f req-c78573de-596f-4367-9ee6-f5f6cf9186c7 tempest-TestShelveInstance-713317852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.074s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:06:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c9587e86-4dcf-4a4a-97de-71d85f311bdd tempest-VolumesTransfersTest-2047213957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:06:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c9587e86-4dcf-4a4a-97de-71d85f311bdd tempest-VolumesTransfersTest-2047213957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:06:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c9587e86-4dcf-4a4a-97de-71d85f311bdd tempest-VolumesTransfersTest-2047213957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:06:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c9587e86-4dcf-4a4a-97de-71d85f311bdd tempest-VolumesTransfersTest-2047213957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:06:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c9587e86-4dcf-4a4a-97de-71d85f311bdd tempest-VolumesTransfersTest-2047213957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:06:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c9587e86-4dcf-4a4a-97de-71d85f311bdd tempest-VolumesTransfersTest-2047213957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:10 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:06:10 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-262c9b43-a85d-41ec-988e-6ae8b6b2792f req-c78573de-596f-4367-9ee6-f5f6cf9186c7 tempest-TestShelveInstance-713317852 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1', 'name': 'volume-c3d28844-92fd-471c-9625-788625ed95c9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9228fb7a-53da-4fdb-8afa-b4a106e1adb7', 'enforce_multipath': True} {{(pid=86977) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 13:06:10 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-262c9b43-a85d-41ec-988e-6ae8b6b2792f req-c78573de-596f-4367-9ee6-f5f6cf9186c7 tempest-TestShelveInstance-713317852 None] attachment_update completed successfully. Jul 14 13:06:10 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c9587e86-4dcf-4a4a-97de-71d85f311bdd tempest-VolumesTransfersTest-2047213957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.287s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:10 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-c9587e86-4dcf-4a4a-97de-71d85f311bdd tempest-VolumesTransfersTest-2047213957 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:06:10 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c9587e86-4dcf-4a4a-97de-71d85f311bdd tempest-VolumesTransfersTest-2047213957 None] Deleted volume successfully. Jul 14 13:06:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c9587e86-4dcf-4a4a-97de-71d85f311bdd tempest-VolumesTransfersTest-2047213957 None] Lock "cinder-13949cb2-9098-4f62-a60f-c580bea0b06b-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:06:11 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:06:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Flow 'volume_create_manager' (0be93fc7-c0e8-4e28-a073-96a273e775c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:06:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1355e5-d552-4e2c-b18b-a786fdba2f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1355e5-d552-4e2c-b18b-a786fdba2f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1610087363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba181d40-c0bb-4461-ac88-e8a3445f44cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29b2f97eb3164bc48db2cbb0a210f926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:06:12Z,use_quota=True,user_id='6972711fe3ed4abfb518ff5454c1512c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (722b1324-be58-456b-b554-374d1854943c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (722b1324-be58-456b-b554-374d1854943c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e1d457-31b8-4907-a1fb-1deff4a22f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e1d457-31b8-4907-a1fb-1deff4a22f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba181d40-c0bb-4461-ac88-e8a3445f44cc', 'volume_name': 'volume-ba181d40-c0bb-4461-ac88-e8a3445f44cc', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e4ddd8-59f7-4f63-8641-979ad1d6512a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e4ddd8-59f7-4f63-8641-979ad1d6512a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28497c6c-96eb-45c7-958e-3fe34753afdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:11 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Volume ba181d40-c0bb-4461-ac88-e8a3445f44cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba181d40-c0bb-4461-ac88-e8a3445f44cc', 'volume_size': 1} Jul 14 13:06:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:06:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:06:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1610087363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba181d40-c0bb-4461-ac88-e8a3445f44cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29b2f97eb3164bc48db2cbb0a210f926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:06:12Z,use_quota=True,user_id='6972711fe3ed4abfb518ff5454c1512c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:06:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Creating volume ba181d40-c0bb-4461-ac88-e8a3445f44cc {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:06:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:06:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:06:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:06:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:06:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:06:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:06:11 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:06:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ba181d40-c0bb-4461-ac88-e8a3445f44cc 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:11 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ba181d40-c0bb-4461-ac88-e8a3445f44cc 1073741824 Jul 14 13:06:11 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:12 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ba181d40-c0bb-4461-ac88-e8a3445f44cc 1073741824" returned: 0 in 0.542s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ba181d40-c0bb-4461-ac88-e8a3445f44cc {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:12 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ba181d40-c0bb-4461-ac88-e8a3445f44cc Jul 14 13:06:12 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:12 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ba181d40-c0bb-4461-ac88-e8a3445f44cc" returned: 0 in 0.295s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:06:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:06:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28497c6c-96eb-45c7-958e-3fe34753afdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba181d40-c0bb-4461-ac88-e8a3445f44cc', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (676b6935-1c67-4130-9d1a-2d8d3c0c0056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:12 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Volume volume-ba181d40-c0bb-4461-ac88-e8a3445f44cc (ba181d40-c0bb-4461-ac88-e8a3445f44cc): created successfully Jul 14 13:06:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (676b6935-1c67-4130-9d1a-2d8d3c0c0056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Flow 'volume_create_manager' (0be93fc7-c0e8-4e28-a073-96a273e775c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:06:12 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-72bf5261-d9a2-44a7-a0e2-6f1480684d74 tempest-VolumesTransfersTest-125053496 None] Created volume successfully. Jul 14 13:06:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ae5d0d37-6725-448b-b0d5-22aaefd8c66b tempest-VolumesTransfersTest-2047213957 None] Acquiring lock "cinder-ba181d40-c0bb-4461-ac88-e8a3445f44cc-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:06:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ae5d0d37-6725-448b-b0d5-22aaefd8c66b tempest-VolumesTransfersTest-2047213957 None] Lock "cinder-ba181d40-c0bb-4461-ac88-e8a3445f44cc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:06:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ae5d0d37-6725-448b-b0d5-22aaefd8c66b tempest-VolumesTransfersTest-2047213957 None] Acquiring lock "cinder-quobyte-ba181d40-c0bb-4461-ac88-e8a3445f44cc" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:06:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ae5d0d37-6725-448b-b0d5-22aaefd8c66b tempest-VolumesTransfersTest-2047213957 None] Lock "cinder-quobyte-ba181d40-c0bb-4461-ac88-e8a3445f44cc" acquired by "delete_volume" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:06:14 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1bea4f-ffd6-4d98-9de1-bf6e7f3464f1]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:06:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ae5d0d37-6725-448b-b0d5-22aaefd8c66b tempest-VolumesTransfersTest-2047213957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ba181d40-c0bb-4461-ac88-e8a3445f44cc {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:15 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ba181d40-c0bb-4461-ac88-e8a3445f44cc Jul 14 13:06:15 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:15 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ae5d0d37-6725-448b-b0d5-22aaefd8c66b tempest-VolumesTransfersTest-2047213957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ba181d40-c0bb-4461-ac88-e8a3445f44cc" returned: 0 in 0.492s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ae5d0d37-6725-448b-b0d5-22aaefd8c66b tempest-VolumesTransfersTest-2047213957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ba181d40-c0bb-4461-ac88-e8a3445f44cc {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:15 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ba181d40-c0bb-4461-ac88-e8a3445f44cc Jul 14 13:06:15 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:15 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ae5d0d37-6725-448b-b0d5-22aaefd8c66b tempest-VolumesTransfersTest-2047213957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ba181d40-c0bb-4461-ac88-e8a3445f44cc" returned: 0 in 0.296s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ae5d0d37-6725-448b-b0d5-22aaefd8c66b tempest-VolumesTransfersTest-2047213957 None] Lock "cinder-quobyte-ba181d40-c0bb-4461-ac88-e8a3445f44cc" released by "delete_volume" :: held 0.864s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:06:15 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-ae5d0d37-6725-448b-b0d5-22aaefd8c66b tempest-VolumesTransfersTest-2047213957 None] Created reservations ['b042d85d-fd63-4494-8921-a95e294fb2a7', '6bb4d26b-ff89-4622-8d48-2fdfb0c83f0c', '1d6677f4-bbe6-4a7d-84b3-811bc0982699', '911f501f-f7ce-42d6-b8b2-cc3a42187560'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:06:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ae5d0d37-6725-448b-b0d5-22aaefd8c66b tempest-VolumesTransfersTest-2047213957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:06:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ae5d0d37-6725-448b-b0d5-22aaefd8c66b tempest-VolumesTransfersTest-2047213957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:06:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ae5d0d37-6725-448b-b0d5-22aaefd8c66b tempest-VolumesTransfersTest-2047213957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:06:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ae5d0d37-6725-448b-b0d5-22aaefd8c66b tempest-VolumesTransfersTest-2047213957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:06:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ae5d0d37-6725-448b-b0d5-22aaefd8c66b tempest-VolumesTransfersTest-2047213957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:06:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ae5d0d37-6725-448b-b0d5-22aaefd8c66b tempest-VolumesTransfersTest-2047213957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:15 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:06:15 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:16 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ae5d0d37-6725-448b-b0d5-22aaefd8c66b tempest-VolumesTransfersTest-2047213957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.416s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-ae5d0d37-6725-448b-b0d5-22aaefd8c66b tempest-VolumesTransfersTest-2047213957 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:06:16 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-ae5d0d37-6725-448b-b0d5-22aaefd8c66b tempest-VolumesTransfersTest-2047213957 None] Deleted volume successfully. Jul 14 13:06:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ae5d0d37-6725-448b-b0d5-22aaefd8c66b tempest-VolumesTransfersTest-2047213957 None] Lock "cinder-ba181d40-c0bb-4461-ac88-e8a3445f44cc-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:06:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:06:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:06:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:06:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:06:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:06:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:06:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:16 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:06:16 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:16 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.326s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:06:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:06:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 28 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 13:06:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 13:06:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-de491db8-8ef5-41cc-bb6a-877e9f5cb55e tempest-VolumesNegativeTest-2014227815 None] Acquiring lock "cinder-092fa53e-ddbc-418f-8c48-d02727650684-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:06:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-de491db8-8ef5-41cc-bb6a-877e9f5cb55e tempest-VolumesNegativeTest-2014227815 None] Lock "cinder-092fa53e-ddbc-418f-8c48-d02727650684-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:06:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-de491db8-8ef5-41cc-bb6a-877e9f5cb55e tempest-VolumesNegativeTest-2014227815 None] Acquiring lock "cinder-quobyte-092fa53e-ddbc-418f-8c48-d02727650684" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:06:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-de491db8-8ef5-41cc-bb6a-877e9f5cb55e tempest-VolumesNegativeTest-2014227815 None] Lock "cinder-quobyte-092fa53e-ddbc-418f-8c48-d02727650684" acquired by "delete_volume" :: waited 0.023s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:06:21 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[84410122-b408-4dcc-b22b-a2dfbc0de1b4]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:06:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-de491db8-8ef5-41cc-bb6a-877e9f5cb55e tempest-VolumesNegativeTest-2014227815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-092fa53e-ddbc-418f-8c48-d02727650684 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:21 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-092fa53e-ddbc-418f-8c48-d02727650684 Jul 14 13:06:21 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:21 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-de491db8-8ef5-41cc-bb6a-877e9f5cb55e tempest-VolumesNegativeTest-2014227815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-092fa53e-ddbc-418f-8c48-d02727650684" returned: 0 in 0.431s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-de491db8-8ef5-41cc-bb6a-877e9f5cb55e tempest-VolumesNegativeTest-2014227815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-092fa53e-ddbc-418f-8c48-d02727650684 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:21 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-092fa53e-ddbc-418f-8c48-d02727650684 Jul 14 13:06:21 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:21 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-de491db8-8ef5-41cc-bb6a-877e9f5cb55e tempest-VolumesNegativeTest-2014227815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-092fa53e-ddbc-418f-8c48-d02727650684" returned: 0 in 0.267s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-de491db8-8ef5-41cc-bb6a-877e9f5cb55e tempest-VolumesNegativeTest-2014227815 None] Lock "cinder-quobyte-092fa53e-ddbc-418f-8c48-d02727650684" released by "delete_volume" :: held 0.751s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:06:21 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-de491db8-8ef5-41cc-bb6a-877e9f5cb55e tempest-VolumesNegativeTest-2014227815 None] Created reservations ['0ed76bde-a780-49bf-b5df-fcabaa9a1078', '3bf3cac3-03b5-48a2-86ac-cceeec1df71a', '3675a95e-c8a8-4f24-9af1-715455d061ca', 'ef2983b3-33bd-4ed7-ba7f-d2f66c5c7fee'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:06:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-de491db8-8ef5-41cc-bb6a-877e9f5cb55e tempest-VolumesNegativeTest-2014227815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:06:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-de491db8-8ef5-41cc-bb6a-877e9f5cb55e tempest-VolumesNegativeTest-2014227815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:06:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-de491db8-8ef5-41cc-bb6a-877e9f5cb55e tempest-VolumesNegativeTest-2014227815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:06:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-de491db8-8ef5-41cc-bb6a-877e9f5cb55e tempest-VolumesNegativeTest-2014227815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:06:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-de491db8-8ef5-41cc-bb6a-877e9f5cb55e tempest-VolumesNegativeTest-2014227815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:06:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-de491db8-8ef5-41cc-bb6a-877e9f5cb55e tempest-VolumesNegativeTest-2014227815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:22 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:06:22 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:22 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-de491db8-8ef5-41cc-bb6a-877e9f5cb55e tempest-VolumesNegativeTest-2014227815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.275s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:22 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-de491db8-8ef5-41cc-bb6a-877e9f5cb55e tempest-VolumesNegativeTest-2014227815 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:06:22 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-de491db8-8ef5-41cc-bb6a-877e9f5cb55e tempest-VolumesNegativeTest-2014227815 None] Deleted volume successfully. Jul 14 13:06:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-de491db8-8ef5-41cc-bb6a-877e9f5cb55e tempest-VolumesNegativeTest-2014227815 None] Lock "cinder-092fa53e-ddbc-418f-8c48-d02727650684-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:06:32 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=27,cinder:INSERT=11,cinder:UPDATE=41,cinder:DELETE=2 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:06:32 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:UPDATE=40,cinder:DELETE=5,cinder:SELECT=34,cinder:INSERT=7 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:06:33 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:06:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Flow 'volume_create_manager' (eec297b9-4a09-4c8c-97e2-4f850dd97d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:06:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db61844d-7719-439f-8ee9-c205e523456f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db61844d-7719-439f-8ee9-c205e523456f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1169840053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4213ae03-5938-452a-ad7a-8ba95b189851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af454bdd60a452bbb9a918fe17f6970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:06:34Z,use_quota=True,user_id='d2a5a581d5094c96ad3ad8cf84d92ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a301d8a-69d3-4616-a5ac-6af5933ab2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a301d8a-69d3-4616-a5ac-6af5933ab2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ed3107-9d91-4a05-b6b4-75cd55adf7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ed3107-9d91-4a05-b6b4-75cd55adf7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4213ae03-5938-452a-ad7a-8ba95b189851', 'volume_name': 'volume-4213ae03-5938-452a-ad7a-8ba95b189851', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17dea50a-23a7-4af7-8a63-718186482a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17dea50a-23a7-4af7-8a63-718186482a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8aaa6d4-f006-4d30-89f2-ed5f5c1306d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:33 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Volume 4213ae03-5938-452a-ad7a-8ba95b189851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4213ae03-5938-452a-ad7a-8ba95b189851', 'volume_size': 1} Jul 14 13:06:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:06:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:06:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1169840053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4213ae03-5938-452a-ad7a-8ba95b189851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af454bdd60a452bbb9a918fe17f6970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:06:34Z,use_quota=True,user_id='d2a5a581d5094c96ad3ad8cf84d92ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:06:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Creating volume 4213ae03-5938-452a-ad7a-8ba95b189851 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:06:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:06:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:06:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:06:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:06:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:06:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:06:33 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:06:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:33 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 1073741824 Jul 14 13:06:33 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:34 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 1073741824" returned: 0 in 0.471s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:34 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 Jul 14 13:06:34 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:34 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851" returned: 0 in 0.246s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:06:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:06:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8aaa6d4-f006-4d30-89f2-ed5f5c1306d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4213ae03-5938-452a-ad7a-8ba95b189851', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835527d7-9c18-4c79-916e-115ff9635319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:34 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Volume volume-4213ae03-5938-452a-ad7a-8ba95b189851 (4213ae03-5938-452a-ad7a-8ba95b189851): created successfully Jul 14 13:06:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835527d7-9c18-4c79-916e-115ff9635319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Flow 'volume_create_manager' (eec297b9-4a09-4c8c-97e2-4f850dd97d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:06:34 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-94e4bb79-43a6-4c3f-99aa-2ca15a5cb066 tempest-VolumesActionsTest-1855850060 None] Created volume successfully. Jul 14 13:06:41 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:06:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Flow 'volume_create_manager' (69f3b108-069d-436d-b1f0-17747c95350f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:06:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f96f539-80a0-4879-8b08-1b0b1e40b012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f96f539-80a0-4879-8b08-1b0b1e40b012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1833663600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45549954-7832-49a4-ba90-8103457a7344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67465275892d48d6af2b280d77b89569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:06:42Z,use_quota=True,user_id='37d23bf3208a479f8da5055709dbf19b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (009fbc23-6d94-4fff-b04e-0ceb489b2745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (009fbc23-6d94-4fff-b04e-0ceb489b2745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0752ab-98ce-44da-a623-8fc09750d41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0752ab-98ce-44da-a623-8fc09750d41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45549954-7832-49a4-ba90-8103457a7344', 'volume_name': 'volume-45549954-7832-49a4-ba90-8103457a7344', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2ec95ba-c8a3-47aa-8d2c-f00fbaf98393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2ec95ba-c8a3-47aa-8d2c-f00fbaf98393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c6d2e2-84ef-4d16-b6de-9addff1c8df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:41 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Volume 45549954-7832-49a4-ba90-8103457a7344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45549954-7832-49a4-ba90-8103457a7344', 'volume_size': 1} Jul 14 13:06:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:06:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:06:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1833663600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45549954-7832-49a4-ba90-8103457a7344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67465275892d48d6af2b280d77b89569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:06:42Z,use_quota=True,user_id='37d23bf3208a479f8da5055709dbf19b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:06:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Creating volume 45549954-7832-49a4-ba90-8103457a7344 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:06:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:06:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:06:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:06:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:06:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:06:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:06:41 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:06:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:41 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344 1073741824 Jul 14 13:06:41 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:42 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344 1073741824" returned: 0 in 0.712s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:42 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344 Jul 14 13:06:42 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:42 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344" returned: 0 in 0.258s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:42 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:06:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:06:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c6d2e2-84ef-4d16-b6de-9addff1c8df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45549954-7832-49a4-ba90-8103457a7344', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4889c0-9e8e-490e-8442-7c370a37a914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:42 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Volume volume-45549954-7832-49a4-ba90-8103457a7344 (45549954-7832-49a4-ba90-8103457a7344): created successfully Jul 14 13:06:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4889c0-9e8e-490e-8442-7c370a37a914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Flow 'volume_create_manager' (69f3b108-069d-436d-b1f0-17747c95350f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:06:42 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-fe7ab6a1-83f8-46e1-8261-cdf1d4423b57 tempest-VolumesSnapshotTestJSON-1172779126 None] Created volume successfully. Jul 14 13:06:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2ad30f06-0c10-47f4-83f4-b5284a3ffc0c tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:06:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2ad30f06-0c10-47f4-83f4-b5284a3ffc0c tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:06:43 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-2ad30f06-0c10-47f4-83f4-b5284a3ffc0c tempest-VolumesSnapshotTestJSON-1172779126 None] Creating offline snapshot 2cbe82f2-552b-4262-9723-96ac16a3dfc0 of volume 45549954-7832-49a4-ba90-8103457a7344 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:06:43 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[c677a1e3-373f-498b-af8c-df0eea1439f3]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:06:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad30f06-0c10-47f4-83f4-b5284a3ffc0c tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:43 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344 Jul 14 13:06:43 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:44 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad30f06-0c10-47f4-83f4-b5284a3ffc0c tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344" returned: 0 in 0.369s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad30f06-0c10-47f4-83f4-b5284a3ffc0c tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.2cbe82f2-552b-4262-9723-96ac16a3dfc0 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:44 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.2cbe82f2-552b-4262-9723-96ac16a3dfc0 1G Jul 14 13:06:44 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:44 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4eba050c-8762-4bcc-a346-4e1d5f7920a8 tempest-VolumesActionsTest-1855850060 None] Acquiring lock "cinder-4213ae03-5938-452a-ad7a-8ba95b189851" by "attach_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:06:44 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4eba050c-8762-4bcc-a346-4e1d5f7920a8 tempest-VolumesActionsTest-1855850060 None] Lock "cinder-4213ae03-5938-452a-ad7a-8ba95b189851" acquired by "attach_volume" :: waited 0.020s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:06:44 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad30f06-0c10-47f4-83f4-b5284a3ffc0c tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.2cbe82f2-552b-4262-9723-96ac16a3dfc0 1G" returned: 0 in 0.463s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad30f06-0c10-47f4-83f4-b5284a3ffc0c tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45549954-7832-49a4-ba90-8103457a7344 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.2cbe82f2-552b-4262-9723-96ac16a3dfc0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:44 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45549954-7832-49a4-ba90-8103457a7344 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.2cbe82f2-552b-4262-9723-96ac16a3dfc0 Jul 14 13:06:44 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:44 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-4eba050c-8762-4bcc-a346-4e1d5f7920a8 tempest-VolumesActionsTest-1855850060 None] Attaching volume 4213ae03-5938-452a-ad7a-8ba95b189851 to instance 58c2da5a-3a7b-435d-9670-447ced6cec8f at mountpoint /dev/vdb on host None. Jul 14 13:06:44 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-4eba050c-8762-4bcc-a346-4e1d5f7920a8 tempest-VolumesActionsTest-1855850060 None] Attach volume completed successfully. Jul 14 13:06:44 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4eba050c-8762-4bcc-a346-4e1d5f7920a8 tempest-VolumesActionsTest-1855850060 None] Lock "cinder-4213ae03-5938-452a-ad7a-8ba95b189851" released by "attach_volume" :: held 0.122s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:06:44 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-09188845-e60e-4484-ac8f-ad928babb2ed tempest-VolumesActionsTest-1855850060 None] Acquiring lock "cinder-4213ae03-5938-452a-ad7a-8ba95b189851-detach_volume" by "detach_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:06:44 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-09188845-e60e-4484-ac8f-ad928babb2ed tempest-VolumesActionsTest-1855850060 None] Lock "cinder-4213ae03-5938-452a-ad7a-8ba95b189851-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:06:44 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-09188845-e60e-4484-ac8f-ad928babb2ed tempest-VolumesActionsTest-1855850060 None] Detaching volume 4213ae03-5938-452a-ad7a-8ba95b189851 from instance 58c2da5a-3a7b-435d-9670-447ced6cec8f. Jul 14 13:06:45 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-09188845-e60e-4484-ac8f-ad928babb2ed tempest-VolumesActionsTest-1855850060 None] Detach volume completed successfully. Jul 14 13:06:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-09188845-e60e-4484-ac8f-ad928babb2ed tempest-VolumesActionsTest-1855850060 None] Lock "cinder-4213ae03-5938-452a-ad7a-8ba95b189851-detach_volume" released by "detach_volume" :: held 0.071s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:06:45 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad30f06-0c10-47f4-83f4-b5284a3ffc0c tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45549954-7832-49a4-ba90-8103457a7344 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.2cbe82f2-552b-4262-9723-96ac16a3dfc0" returned: 0 in 0.401s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:45 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-2ad30f06-0c10-47f4-83f4-b5284a3ffc0c tempest-VolumesSnapshotTestJSON-1172779126 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.2cbe82f2-552b-4262-9723-96ac16a3dfc0 is being set with open permissions: ugo+rw Jul 14 13:06:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad30f06-0c10-47f4-83f4-b5284a3ffc0c tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.2cbe82f2-552b-4262-9723-96ac16a3dfc0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:45 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.2cbe82f2-552b-4262-9723-96ac16a3dfc0 Jul 14 13:06:45 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:45 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad30f06-0c10-47f4-83f4-b5284a3ffc0c tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.2cbe82f2-552b-4262-9723-96ac16a3dfc0" returned: 0 in 0.306s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad30f06-0c10-47f4-83f4-b5284a3ffc0c tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:45 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.info Jul 14 13:06:45 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:45 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad30f06-0c10-47f4-83f4-b5284a3ffc0c tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.info" returned: 0 in 0.294s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:45 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-2ad30f06-0c10-47f4-83f4-b5284a3ffc0c tempest-VolumesSnapshotTestJSON-1172779126 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.info is being set with open permissions: ugo+rw Jul 14 13:06:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad30f06-0c10-47f4-83f4-b5284a3ffc0c tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:45 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.info Jul 14 13:06:45 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:46 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad30f06-0c10-47f4-83f4-b5284a3ffc0c tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.info" returned: 0 in 0.345s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2ad30f06-0c10-47f4-83f4-b5284a3ffc0c tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.289s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:06:46 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-2ad30f06-0c10-47f4-83f4-b5284a3ffc0c tempest-VolumesSnapshotTestJSON-1172779126 None] Create snapshot completed successfully Jul 14 13:06:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ebb9cfbb-c15f-47ec-a8cb-f8f6cce97af4 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-2cbe82f2-552b-4262-9723-96ac16a3dfc0-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:06:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ebb9cfbb-c15f-47ec-a8cb-f8f6cce97af4 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-2cbe82f2-552b-4262-9723-96ac16a3dfc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:06:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ebb9cfbb-c15f-47ec-a8cb-f8f6cce97af4 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-quobyte-45549954-7832-49a4-ba90-8103457a7344" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:06:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ebb9cfbb-c15f-47ec-a8cb-f8f6cce97af4 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-45549954-7832-49a4-ba90-8103457a7344" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:06:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ebb9cfbb-c15f-47ec-a8cb-f8f6cce97af4 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-quobyte-2cbe82f2-552b-4262-9723-96ac16a3dfc0" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:06:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ebb9cfbb-c15f-47ec-a8cb-f8f6cce97af4 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-2cbe82f2-552b-4262-9723-96ac16a3dfc0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:06:47 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-ebb9cfbb-c15f-47ec-a8cb-f8f6cce97af4 tempest-VolumesSnapshotTestJSON-1172779126 None] Deleting offline snapshot 2cbe82f2-552b-4262-9723-96ac16a3dfc0 of volume 45549954-7832-49a4-ba90-8103457a7344 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:06:47 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-ebb9cfbb-c15f-47ec-a8cb-f8f6cce97af4 tempest-VolumesSnapshotTestJSON-1172779126 None] snapshot_file for this snap is: volume-45549954-7832-49a4-ba90-8103457a7344.2cbe82f2-552b-4262-9723-96ac16a3dfc0 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:06:47 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e179e0f-2bfd-4308-96c7-b2a98c855f48]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:06:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ebb9cfbb-c15f-47ec-a8cb-f8f6cce97af4 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.2cbe82f2-552b-4262-9723-96ac16a3dfc0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:47 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.2cbe82f2-552b-4262-9723-96ac16a3dfc0 Jul 14 13:06:47 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:47 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ebb9cfbb-c15f-47ec-a8cb-f8f6cce97af4 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.2cbe82f2-552b-4262-9723-96ac16a3dfc0" returned: 0 in 0.371s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:47 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-ebb9cfbb-c15f-47ec-a8cb-f8f6cce97af4 tempest-VolumesSnapshotTestJSON-1172779126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45549954-7832-49a4-ba90-8103457a7344(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:06:47 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[12982451-f40b-4e89-aeb4-45bfe374fc90]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:06:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ebb9cfbb-c15f-47ec-a8cb-f8f6cce97af4 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:47 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344 Jul 14 13:06:47 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:47 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ebb9cfbb-c15f-47ec-a8cb-f8f6cce97af4 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344" returned: 0 in 0.363s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ebb9cfbb-c15f-47ec-a8cb-f8f6cce97af4 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.2cbe82f2-552b-4262-9723-96ac16a3dfc0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:48 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.2cbe82f2-552b-4262-9723-96ac16a3dfc0 Jul 14 13:06:48 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:48 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ebb9cfbb-c15f-47ec-a8cb-f8f6cce97af4 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.2cbe82f2-552b-4262-9723-96ac16a3dfc0" returned: 0 in 0.372s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ebb9cfbb-c15f-47ec-a8cb-f8f6cce97af4 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.2cbe82f2-552b-4262-9723-96ac16a3dfc0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:48 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.2cbe82f2-552b-4262-9723-96ac16a3dfc0 Jul 14 13:06:48 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:48 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ebb9cfbb-c15f-47ec-a8cb-f8f6cce97af4 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344.2cbe82f2-552b-4262-9723-96ac16a3dfc0" returned: 0 in 0.286s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:48 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ebb9cfbb-c15f-47ec-a8cb-f8f6cce97af4 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-2cbe82f2-552b-4262-9723-96ac16a3dfc0" released by "_delete_snapshot" :: held 1.507s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:06:48 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ebb9cfbb-c15f-47ec-a8cb-f8f6cce97af4 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-45549954-7832-49a4-ba90-8103457a7344" released by "delete_snapshot" :: held 1.534s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:06:48 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-ebb9cfbb-c15f-47ec-a8cb-f8f6cce97af4 tempest-VolumesSnapshotTestJSON-1172779126 None] Created reservations ['6e7b0cfb-3b70-4785-a552-bebaa828f2af', '8aa003c2-abea-41c5-9a38-d4bbf4df2dd9', 'e75b73a8-f13f-4c86-88e1-53af5cb9fc2c', 'f0718837-3d03-42e2-a461-f56ff92f9c4a'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:06:48 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-ebb9cfbb-c15f-47ec-a8cb-f8f6cce97af4 tempest-VolumesSnapshotTestJSON-1172779126 None] Delete snapshot completed successfully. Jul 14 13:06:48 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ebb9cfbb-c15f-47ec-a8cb-f8f6cce97af4 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-2cbe82f2-552b-4262-9723-96ac16a3dfc0-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:06:49 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:06:49 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Flow 'volume_create_manager' (095ce159-94f9-4f6d-b4f0-f99971691154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:06:49 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795d153a-5909-4945-a5b2-0e970a2955c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:49 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795d153a-5909-4945-a5b2-0e970a2955c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1719098776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5482f57b-cb45-4cbb-9e7c-ab0922718dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67465275892d48d6af2b280d77b89569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:06:50Z,use_quota=True,user_id='37d23bf3208a479f8da5055709dbf19b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:49 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6cc152-f63c-4323-ad7a-70368e626405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:49 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6cc152-f63c-4323-ad7a-70368e626405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:49 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e0bf40-4e1d-4c38-b444-16f21033e249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:49 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e0bf40-4e1d-4c38-b444-16f21033e249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5482f57b-cb45-4cbb-9e7c-ab0922718dfe', 'volume_name': 'volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14ac4481-b60a-41e7-979f-ae99a1a581a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14ac4481-b60a-41e7-979f-ae99a1a581a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5bfd667-6e6a-4e5c-bb4d-34e9c1a4d66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:50 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Volume 5482f57b-cb45-4cbb-9e7c-ab0922718dfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe', 'volume_size': 1} Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1719098776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5482f57b-cb45-4cbb-9e7c-ab0922718dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67465275892d48d6af2b280d77b89569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:06:50Z,use_quota=True,user_id='37d23bf3208a479f8da5055709dbf19b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Creating volume 5482f57b-cb45-4cbb-9e7c-ab0922718dfe {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:06:50 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:50 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe 1073741824 Jul 14 13:06:50 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:50 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe 1073741824" returned: 0 in 0.496s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:50 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe Jul 14 13:06:50 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:50 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe" returned: 0 in 0.306s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5bfd667-6e6a-4e5c-bb4d-34e9c1a4d66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7753020b-0d43-4ed5-b0a3-3c9351ca19f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:50 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Volume volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe (5482f57b-cb45-4cbb-9e7c-ab0922718dfe): created successfully Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7753020b-0d43-4ed5-b0a3-3c9351ca19f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:50 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Flow 'volume_create_manager' (095ce159-94f9-4f6d-b4f0-f99971691154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:06:50 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e97f35f0-5908-41f6-97e7-8ae93a718170 tempest-VolumesSnapshotTestJSON-1172779126 None] Created volume successfully. Jul 14 13:06:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0afbb0fc-bf94-4401-ba6a-763e526a052b tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:06:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0afbb0fc-bf94-4401-ba6a-763e526a052b tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:06:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-0afbb0fc-bf94-4401-ba6a-763e526a052b tempest-VolumesSnapshotTestJSON-1172779126 None] Creating offline snapshot 3677e72f-8e53-47f1-8045-4e91fa29e3c0 of volume 5482f57b-cb45-4cbb-9e7c-ab0922718dfe {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:06:52 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[90478a81-31dc-4764-8ed8-55f5a6c6caa9]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:06:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0afbb0fc-bf94-4401-ba6a-763e526a052b tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:52 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe Jul 14 13:06:52 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:52 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0afbb0fc-bf94-4401-ba6a-763e526a052b tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe" returned: 0 in 0.392s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0afbb0fc-bf94-4401-ba6a-763e526a052b tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:52 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0 1G Jul 14 13:06:52 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:53 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0afbb0fc-bf94-4401-ba6a-763e526a052b tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0 1G" returned: 0 in 0.446s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0afbb0fc-bf94-4401-ba6a-763e526a052b tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:53 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0 Jul 14 13:06:53 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:53 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0afbb0fc-bf94-4401-ba6a-763e526a052b tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0" returned: 0 in 0.518s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:53 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-0afbb0fc-bf94-4401-ba6a-763e526a052b tempest-VolumesSnapshotTestJSON-1172779126 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0 is being set with open permissions: ugo+rw Jul 14 13:06:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0afbb0fc-bf94-4401-ba6a-763e526a052b tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:53 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0 Jul 14 13:06:53 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:54 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0afbb0fc-bf94-4401-ba6a-763e526a052b tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0" returned: 0 in 0.512s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0afbb0fc-bf94-4401-ba6a-763e526a052b tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:54 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.info Jul 14 13:06:54 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:54 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0afbb0fc-bf94-4401-ba6a-763e526a052b tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.info" returned: 0 in 0.584s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:54 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-0afbb0fc-bf94-4401-ba6a-763e526a052b tempest-VolumesSnapshotTestJSON-1172779126 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.info is being set with open permissions: ugo+rw Jul 14 13:06:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0afbb0fc-bf94-4401-ba6a-763e526a052b tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:54 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.info Jul 14 13:06:54 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:55 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0afbb0fc-bf94-4401-ba6a-763e526a052b tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.info" returned: 0 in 0.635s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0afbb0fc-bf94-4401-ba6a-763e526a052b tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.246s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:06:55 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-0afbb0fc-bf94-4401-ba6a-763e526a052b tempest-VolumesSnapshotTestJSON-1172779126 None] Create snapshot completed successfully Jul 14 13:06:56 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-5289e4b5-1cc8-47be-915b-a76b4a176be2 tempest-TestShelveInstance-713317852 None] Terminate volume connection completed successfully. Jul 14 13:06:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-5289e4b5-1cc8-47be-915b-a76b4a176be2 tempest-TestShelveInstance-713317852 None] Deleting attachment 9228fb7a-53da-4fdb-8afa-b4a106e1adb7. {{(pid=86977) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 13:06:56 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] Acquiring lock "cinder-c3d28844-92fd-471c-9625-788625ed95c9-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:06:56 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] Lock "cinder-c3d28844-92fd-471c-9625-788625ed95c9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:06:56 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] Acquiring lock "cinder-quobyte-c3d28844-92fd-471c-9625-788625ed95c9" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:06:56 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] Lock "cinder-quobyte-c3d28844-92fd-471c-9625-788625ed95c9" acquired by "delete_volume" :: waited 0.026s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:06:56 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a698cd6-9efb-4cea-b612-aee76a210463]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:06:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:57 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 Jul 14 13:06:57 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Flow 'volume_create_manager' (7d4fe9d4-72b3-4814-bde6-8f7fab757cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e5df03-e224-4a1d-843b-588cc68b5eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f933638a-f524-43c4-b5ce-78ea03dacc4c tempest-VolumesActionsTest-1855850060 None] Acquiring lock "cinder-4213ae03-5938-452a-ad7a-8ba95b189851" by "attach_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:06:57 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e5df03-e224-4a1d-843b-588cc68b5eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-242003884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89baff2d-a87f-461d-9e9f-2a28052adfcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67465275892d48d6af2b280d77b89569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:06:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3677e72f-8e53-47f1-8045-4e91fa29e3c0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:06:57Z,use_quota=True,user_id='37d23bf3208a479f8da5055709dbf19b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a2cc56c-5aa8-4322-9142-d6cb70ba3747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a2cc56c-5aa8-4322-9142-d6cb70ba3747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f62ae94-2004-4d6e-936f-0827d58c3608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f62ae94-2004-4d6e-936f-0827d58c3608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '89baff2d-a87f-461d-9e9f-2a28052adfcd', 'volume_name': 'volume-89baff2d-a87f-461d-9e9f-2a28052adfcd', 'volume_size': 2, 'snapshot_id': '3677e72f-8e53-47f1-8045-4e91fa29e3c0'}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9220b6b1-7927-4206-88d8-1cee8bf9eaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9220b6b1-7927-4206-88d8-1cee8bf9eaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54965f9b-e385-46f2-97ce-c9bb1adf35b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:06:57 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Volume 89baff2d-a87f-461d-9e9f-2a28052adfcd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-89baff2d-a87f-461d-9e9f-2a28052adfcd', 'volume_size': 2, 'snapshot_id': '3677e72f-8e53-47f1-8045-4e91fa29e3c0'} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9" returned: 0 in 0.650s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f933638a-f524-43c4-b5ce-78ea03dacc4c tempest-VolumesActionsTest-1855850060 None] Lock "cinder-4213ae03-5938-452a-ad7a-8ba95b189851" acquired by "attach_volume" :: waited 0.129s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-quobyte-3677e72f-8e53-47f1-8045-4e91fa29e3c0-89baff2d-a87f-461d-9e9f-2a28052adfcd" by "_create_volume_from_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-3677e72f-8e53-47f1-8045-4e91fa29e3c0-89baff2d-a87f-461d-9e9f-2a28052adfcd" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Creating volume 89baff2d-a87f-461d-9e9f-2a28052adfcd from snapshot 3677e72f-8e53-47f1-8045-4e91fa29e3c0 {{(pid=86977) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-quobyte-89baff2d-a87f-461d-9e9f-2a28052adfcd" by "_copy_volume_from_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-89baff2d-a87f-461d-9e9f-2a28052adfcd" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] snapshot: 3677e72f-8e53-47f1-8045-4e91fa29e3c0, volume: 89baff2d-a87f-461d-9e9f-2a28052adfcd, {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:06:57 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-f933638a-f524-43c4-b5ce-78ea03dacc4c tempest-VolumesActionsTest-1855850060 None] Attaching volume 4213ae03-5938-452a-ad7a-8ba95b189851 to instance 4c89b953-4890-4455-b622-07ea823ae242 at mountpoint /dev/vdb on host None. Jul 14 13:06:57 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 Jul 14 13:06:57 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[6229e9c7-37f9-4d8b-8f90-d8a80dcb349b]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:57 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-f933638a-f524-43c4-b5ce-78ea03dacc4c tempest-VolumesActionsTest-1855850060 None] Attach volume completed successfully. Jul 14 13:06:57 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f933638a-f524-43c4-b5ce-78ea03dacc4c tempest-VolumesActionsTest-1855850060 None] Lock "cinder-4213ae03-5938-452a-ad7a-8ba95b189851" released by "attach_volume" :: held 0.215s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:06:57 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0 Jul 14 13:06:57 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7a23cdf1-70a8-4797-9919-7c2ebd5e6b6c tempest-VolumesActionsTest-1855850060 None] Acquiring lock "cinder-4213ae03-5938-452a-ad7a-8ba95b189851-detach_volume" by "detach_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:06:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7a23cdf1-70a8-4797-9919-7c2ebd5e6b6c tempest-VolumesActionsTest-1855850060 None] Lock "cinder-4213ae03-5938-452a-ad7a-8ba95b189851-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:06:58 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-7a23cdf1-70a8-4797-9919-7c2ebd5e6b6c tempest-VolumesActionsTest-1855850060 None] Detaching volume 4213ae03-5938-452a-ad7a-8ba95b189851 from instance 4c89b953-4890-4455-b622-07ea823ae242. Jul 14 13:06:58 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-7a23cdf1-70a8-4797-9919-7c2ebd5e6b6c tempest-VolumesActionsTest-1855850060 None] Detach volume completed successfully. Jul 14 13:06:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7a23cdf1-70a8-4797-9919-7c2ebd5e6b6c tempest-VolumesActionsTest-1855850060 None] Lock "cinder-4213ae03-5938-452a-ad7a-8ba95b189851-detach_volume" released by "detach_volume" :: held 0.084s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:06:58 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9" returned: 1 in 0.626s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:06:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:58 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9 Jul 14 13:06:58 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:58 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0" returned: 0 in 0.617s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:06:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 13:06:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Creating direct copy from snapshot {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 13:06:58 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adac646-469b-4a4d-9e75-ef1d6ca4f3ba]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:06:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:58 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3d28844-92fd-471c-9625-788625ed95c9" returned: 0 in 0.374s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:58 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe Jul 14 13:06:58 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] Lock "cinder-quobyte-c3d28844-92fd-471c-9625-788625ed95c9" released by "delete_volume" :: held 1.761s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:06:58 devstack cinder-volume[86977]: DEBUG cinder.quota [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] Created reservations ['912e18d3-0d81-4fc1-b7f7-48aa5f29d127', 'beef8410-fc12-4819-a2cd-ce83f1e0b331', 'e346fa33-c4ec-4ac5-923e-72c4bd768707', 'e9351253-8c49-4726-bae8-639aae60f50b'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:06:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:06:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:06:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:06:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:06:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:06:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:58 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:06:58 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:59 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe" returned: 0 in 0.613s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:59 devstack cinder-volume[86977]: DEBUG cinder.utils [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Path /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-89baff2d-a87f-461d-9e9f-2a28052adfcd not found in is_blk_device check {{(pid=86977) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 13:06:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-89baff2d-a87f-461d-9e9f-2a28052adfcd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:06:59 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-89baff2d-a87f-461d-9e9f-2a28052adfcd Jul 14 13:06:59 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:06:59 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Jul 14 13:06:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.504s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:06:59 devstack cinder-volume[86977]: DEBUG cinder.manager [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:06:59 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] Deleted volume successfully. Jul 14 13:06:59 devstack cinder-volume[86977]: DEBUG cinder.coordination [req-2c2b497b-4205-4cec-b121-f9e4bf86af3f req-f7b084c0-94d6-4e3f-9233-46cc3c190aaf tempest-TestShelveInstance-713317852 None] Lock "cinder-c3d28844-92fd-471c-9625-788625ed95c9-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:07:05 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-89baff2d-a87f-461d-9e9f-2a28052adfcd" returned: 0 in 6.289s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:05 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49e51c4-9f08-44ce-94a5-fd4a1544b42e]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:07:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:05 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe Jul 14 13:07:05 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-138ea24a-e5d0-4c04-ba46-1ed0b31a1ded tempest-VolumesActionsTest-1855850060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:07:06 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe" returned: 0 in 0.681s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:06 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Image conversion details: src /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe, size 1024.00 MB, duration 6.29 sec, destination /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-89baff2d-a87f-461d-9e9f-2a28052adfcd {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:07:06 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Converted 1024.00 MB image at 162.80 MB/s Jul 14 13:07:06 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-89baff2d-a87f-461d-9e9f-2a28052adfcd is being set with open permissions: ugo+rw Jul 14 13:07:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-89baff2d-a87f-461d-9e9f-2a28052adfcd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:06 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-89baff2d-a87f-461d-9e9f-2a28052adfcd Jul 14 13:07:06 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:06 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-89baff2d-a87f-461d-9e9f-2a28052adfcd" returned: 0 in 0.266s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-89baff2d-a87f-461d-9e9f-2a28052adfcd" released by "_copy_volume_from_snapshot" :: held 8.630s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:07:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-3677e72f-8e53-47f1-8045-4e91fa29e3c0-89baff2d-a87f-461d-9e9f-2a28052adfcd" released by "_create_volume_from_snapshot" :: held 8.677s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:07:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.711s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:07:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-138ea24a-e5d0-4c04-ba46-1ed0b31a1ded tempest-VolumesActionsTest-1855850060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.527s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:07:06 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cc4f96-8315-404e-b1ae-fffd496e69c4]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:07:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-138ea24a-e5d0-4c04-ba46-1ed0b31a1ded tempest-VolumesActionsTest-1855850060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54965f9b-e385-46f2-97ce-c9bb1adf35b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89baff2d-a87f-461d-9e9f-2a28052adfcd', 'volume_size': 2, 'snapshot_id': '3677e72f-8e53-47f1-8045-4e91fa29e3c0'}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:07:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40ecbf0-e864-437b-8476-4617e0a8f4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:07:06 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Volume volume-89baff2d-a87f-461d-9e9f-2a28052adfcd (89baff2d-a87f-461d-9e9f-2a28052adfcd): created successfully Jul 14 13:07:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40ecbf0-e864-437b-8476-4617e0a8f4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:07:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Flow 'volume_create_manager' (7d4fe9d4-72b3-4814-bde6-8f7fab757cc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:07:06 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-fb0cd771-cfed-467e-9ebf-dc6ec1c206ec tempest-VolumesSnapshotTestJSON-1172779126 None] Created volume successfully. Jul 14 13:07:06 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 Jul 14 13:07:06 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:06 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-138ea24a-e5d0-4c04-ba46-1ed0b31a1ded tempest-VolumesActionsTest-1855850060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851" returned: 0 in 0.367s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:06 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[823cb343-265d-4901-8672-b9c971a6c02f]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:07:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-138ea24a-e5d0-4c04-ba46-1ed0b31a1ded tempest-VolumesActionsTest-1855850060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:06 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 Jul 14 13:07:06 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:07 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-138ea24a-e5d0-4c04-ba46-1ed0b31a1ded tempest-VolumesActionsTest-1855850060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851" returned: 0 in 0.386s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-138ea24a-e5d0-4c04-ba46-1ed0b31a1ded tempest-VolumesActionsTest-1855850060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 /opt/stack/data/cinder/conversion/4213ae03-5938-452a-ad7a-8ba95b189851.temp_image.eb8be177-5923-4c1c-982f-a36ba63f803bq2izxcw6.img {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:07 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 /opt/stack/data/cinder/conversion/4213ae03-5938-452a-ad7a-8ba95b189851.temp_image.eb8be177-5923-4c1c-982f-a36ba63f803bq2izxcw6.img Jul 14 13:07:07 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4e746ab1-aab2-4475-a6a8-9f4ec7c82478 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-89baff2d-a87f-461d-9e9f-2a28052adfcd-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:07:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4e746ab1-aab2-4475-a6a8-9f4ec7c82478 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-89baff2d-a87f-461d-9e9f-2a28052adfcd-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:07:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4e746ab1-aab2-4475-a6a8-9f4ec7c82478 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-quobyte-89baff2d-a87f-461d-9e9f-2a28052adfcd" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:07:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4e746ab1-aab2-4475-a6a8-9f4ec7c82478 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-89baff2d-a87f-461d-9e9f-2a28052adfcd" acquired by "delete_volume" :: waited 0.041s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:07:07 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e22a68-4322-4432-afb5-59f9df60affe]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:07:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4e746ab1-aab2-4475-a6a8-9f4ec7c82478 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-89baff2d-a87f-461d-9e9f-2a28052adfcd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:08 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-89baff2d-a87f-461d-9e9f-2a28052adfcd Jul 14 13:07:08 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:08 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4e746ab1-aab2-4475-a6a8-9f4ec7c82478 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-89baff2d-a87f-461d-9e9f-2a28052adfcd" returned: 0 in 0.845s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4e746ab1-aab2-4475-a6a8-9f4ec7c82478 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-89baff2d-a87f-461d-9e9f-2a28052adfcd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:08 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-89baff2d-a87f-461d-9e9f-2a28052adfcd Jul 14 13:07:08 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:09 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4e746ab1-aab2-4475-a6a8-9f4ec7c82478 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-89baff2d-a87f-461d-9e9f-2a28052adfcd" returned: 0 in 0.979s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4e746ab1-aab2-4475-a6a8-9f4ec7c82478 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-89baff2d-a87f-461d-9e9f-2a28052adfcd" released by "delete_volume" :: held 1.940s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:07:09 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-4e746ab1-aab2-4475-a6a8-9f4ec7c82478 tempest-VolumesSnapshotTestJSON-1172779126 None] Created reservations ['5cadce7c-7629-45e1-86a6-6683c8ed12e4', 'f5422059-af49-4e99-b0ad-ecf125625cf8', '078f535c-b25f-439d-9d7f-5d02d3735727', 'fe3aeeac-219b-4a32-bbb7-98cfc4f6577b'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:07:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4e746ab1-aab2-4475-a6a8-9f4ec7c82478 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:07:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4e746ab1-aab2-4475-a6a8-9f4ec7c82478 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:07:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4e746ab1-aab2-4475-a6a8-9f4ec7c82478 tempest-VolumesSnapshotTestJSON-1172779126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:07:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4e746ab1-aab2-4475-a6a8-9f4ec7c82478 tempest-VolumesSnapshotTestJSON-1172779126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:07:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4e746ab1-aab2-4475-a6a8-9f4ec7c82478 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:07:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4e746ab1-aab2-4475-a6a8-9f4ec7c82478 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:10 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:07:10 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-30cec82e-5335-4890-b52d-b08ad8c7e045 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-3677e72f-8e53-47f1-8045-4e91fa29e3c0-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:07:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-30cec82e-5335-4890-b52d-b08ad8c7e045 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-3677e72f-8e53-47f1-8045-4e91fa29e3c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:07:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-30cec82e-5335-4890-b52d-b08ad8c7e045 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-quobyte-5482f57b-cb45-4cbb-9e7c-ab0922718dfe" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:07:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-30cec82e-5335-4890-b52d-b08ad8c7e045 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-5482f57b-cb45-4cbb-9e7c-ab0922718dfe" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:07:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-30cec82e-5335-4890-b52d-b08ad8c7e045 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-quobyte-3677e72f-8e53-47f1-8045-4e91fa29e3c0" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:07:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-30cec82e-5335-4890-b52d-b08ad8c7e045 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-3677e72f-8e53-47f1-8045-4e91fa29e3c0" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:07:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-30cec82e-5335-4890-b52d-b08ad8c7e045 tempest-VolumesSnapshotTestJSON-1172779126 None] Deleting offline snapshot 3677e72f-8e53-47f1-8045-4e91fa29e3c0 of volume 5482f57b-cb45-4cbb-9e7c-ab0922718dfe {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:07:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-30cec82e-5335-4890-b52d-b08ad8c7e045 tempest-VolumesSnapshotTestJSON-1172779126 None] snapshot_file for this snap is: volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:07:10 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a569ad4-e168-4bee-bc69-320276766801]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:07:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-30cec82e-5335-4890-b52d-b08ad8c7e045 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:10 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4e746ab1-aab2-4475-a6a8-9f4ec7c82478 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.819s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:10 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-4e746ab1-aab2-4475-a6a8-9f4ec7c82478 tempest-VolumesSnapshotTestJSON-1172779126 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:07:10 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-4e746ab1-aab2-4475-a6a8-9f4ec7c82478 tempest-VolumesSnapshotTestJSON-1172779126 None] Deleted volume successfully. Jul 14 13:07:10 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0 Jul 14 13:07:10 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4e746ab1-aab2-4475-a6a8-9f4ec7c82478 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-89baff2d-a87f-461d-9e9f-2a28052adfcd-delete_volume" released by "delete_volume" :: held 3.294s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:07:11 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-30cec82e-5335-4890-b52d-b08ad8c7e045 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0" returned: 0 in 1.084s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-30cec82e-5335-4890-b52d-b08ad8c7e045 tempest-VolumesSnapshotTestJSON-1172779126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:07:11 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b47561-9e56-4a6e-8a0f-982bb75bceb2]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:07:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-30cec82e-5335-4890-b52d-b08ad8c7e045 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:12 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe Jul 14 13:07:12 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-138ea24a-e5d0-4c04-ba46-1ed0b31a1ded tempest-VolumesActionsTest-1855850060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 /opt/stack/data/cinder/conversion/4213ae03-5938-452a-ad7a-8ba95b189851.temp_image.eb8be177-5923-4c1c-982f-a36ba63f803bq2izxcw6.img" returned: 0 in 5.388s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:12 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:12 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b187300-35ed-4f1a-9924-6badf5d86469]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:07:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-138ea24a-e5d0-4c04-ba46-1ed0b31a1ded tempest-VolumesActionsTest-1855850060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-30cec82e-5335-4890-b52d-b08ad8c7e045 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe" returned: 0 in 0.770s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-30cec82e-5335-4890-b52d-b08ad8c7e045 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:12 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0 Jul 14 13:07:12 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:12 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 Jul 14 13:07:12 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:12 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-30cec82e-5335-4890-b52d-b08ad8c7e045 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0" returned: 0 in 0.385s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-30cec82e-5335-4890-b52d-b08ad8c7e045 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:12 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0 Jul 14 13:07:12 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:13 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-138ea24a-e5d0-4c04-ba46-1ed0b31a1ded tempest-VolumesActionsTest-1855850060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851" returned: 0 in 0.635s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:13 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-138ea24a-e5d0-4c04-ba46-1ed0b31a1ded tempest-VolumesActionsTest-1855850060 None] Image conversion details: src /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851, size 1024.00 MB, duration 5.39 sec, destination /opt/stack/data/cinder/conversion/4213ae03-5938-452a-ad7a-8ba95b189851.temp_image.eb8be177-5923-4c1c-982f-a36ba63f803bq2izxcw6.img {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:07:13 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-138ea24a-e5d0-4c04-ba46-1ed0b31a1ded tempest-VolumesActionsTest-1855850060 None] Converted 1024.00 MB image at 190.01 MB/s Jul 14 13:07:13 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-138ea24a-e5d0-4c04-ba46-1ed0b31a1ded tempest-VolumesActionsTest-1855850060 None] eb8be177-5923-4c1c-982f-a36ba63f803b was raw, no need to convert to raw {{(pid=86977) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1178}} Jul 14 13:07:13 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-30cec82e-5335-4890-b52d-b08ad8c7e045 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe.3677e72f-8e53-47f1-8045-4e91fa29e3c0" returned: 0 in 0.300s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-30cec82e-5335-4890-b52d-b08ad8c7e045 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-3677e72f-8e53-47f1-8045-4e91fa29e3c0" released by "_delete_snapshot" :: held 2.829s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:07:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-30cec82e-5335-4890-b52d-b08ad8c7e045 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-5482f57b-cb45-4cbb-9e7c-ab0922718dfe" released by "delete_snapshot" :: held 2.877s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:07:13 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-30cec82e-5335-4890-b52d-b08ad8c7e045 tempest-VolumesSnapshotTestJSON-1172779126 None] Created reservations ['8005be60-44f6-4213-86b4-dc28f8c32824', 'aa5291d2-07cd-4332-9c7e-b07b1a1bb3e6', '5090a34a-48b7-487b-a313-ac41659142cf', 'cc15117a-48a0-4b32-9466-a9e07d0f5079'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:07:13 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-30cec82e-5335-4890-b52d-b08ad8c7e045 tempest-VolumesSnapshotTestJSON-1172779126 None] Delete snapshot completed successfully. Jul 14 13:07:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-30cec82e-5335-4890-b52d-b08ad8c7e045 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-3677e72f-8e53-47f1-8045-4e91fa29e3c0-delete_snapshot" released by "delete_snapshot" :: held 3.088s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:07:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a2177674-dad1-44eb-b791-91a60a5711cf tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-5482f57b-cb45-4cbb-9e7c-ab0922718dfe-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:07:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a2177674-dad1-44eb-b791-91a60a5711cf tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-5482f57b-cb45-4cbb-9e7c-ab0922718dfe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:07:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a2177674-dad1-44eb-b791-91a60a5711cf tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-quobyte-5482f57b-cb45-4cbb-9e7c-ab0922718dfe" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:07:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a2177674-dad1-44eb-b791-91a60a5711cf tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-5482f57b-cb45-4cbb-9e7c-ab0922718dfe" acquired by "delete_volume" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:07:13 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c86f341-cad6-4126-9301-9cc096774f8e]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:07:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a2177674-dad1-44eb-b791-91a60a5711cf tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:14 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe Jul 14 13:07:14 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:14 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a2177674-dad1-44eb-b791-91a60a5711cf tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe" returned: 0 in 0.438s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a2177674-dad1-44eb-b791-91a60a5711cf tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:14 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe Jul 14 13:07:14 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:14 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a2177674-dad1-44eb-b791-91a60a5711cf tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5482f57b-cb45-4cbb-9e7c-ab0922718dfe" returned: 0 in 0.270s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a2177674-dad1-44eb-b791-91a60a5711cf tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-5482f57b-cb45-4cbb-9e7c-ab0922718dfe" released by "delete_volume" :: held 0.795s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:07:14 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-a2177674-dad1-44eb-b791-91a60a5711cf tempest-VolumesSnapshotTestJSON-1172779126 None] Created reservations ['c5fac627-0567-4cdc-8b35-4e327b19afd3', '5331d873-4eb6-4b2a-ae96-43bad1301f6e', '15fc3a55-5104-46f3-af53-c2454bcdae2b', '5343c639-a68e-4e62-8ff0-9cf3127004b6'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:07:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a2177674-dad1-44eb-b791-91a60a5711cf tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:07:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a2177674-dad1-44eb-b791-91a60a5711cf tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:07:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a2177674-dad1-44eb-b791-91a60a5711cf tempest-VolumesSnapshotTestJSON-1172779126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:07:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a2177674-dad1-44eb-b791-91a60a5711cf tempest-VolumesSnapshotTestJSON-1172779126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:07:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a2177674-dad1-44eb-b791-91a60a5711cf tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:07:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a2177674-dad1-44eb-b791-91a60a5711cf tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:14 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:07:14 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:15 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a2177674-dad1-44eb-b791-91a60a5711cf tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.309s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:15 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-a2177674-dad1-44eb-b791-91a60a5711cf tempest-VolumesSnapshotTestJSON-1172779126 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:07:15 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-a2177674-dad1-44eb-b791-91a60a5711cf tempest-VolumesSnapshotTestJSON-1172779126 None] Deleted volume successfully. Jul 14 13:07:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a2177674-dad1-44eb-b791-91a60a5711cf tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-5482f57b-cb45-4cbb-9e7c-ab0922718dfe-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:07:15 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:07:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Flow 'volume_create_manager' (907edc81-9d13-49b9-aa22-31e6537824f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:07:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d95cfe8-eaa7-4ec2-9f57-704e7e0913fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:07:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d95cfe8-eaa7-4ec2-9f57-704e7e0913fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1426600057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc652adb-23ce-40ab-93a0-799ca2e2fa2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67465275892d48d6af2b280d77b89569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:07:16Z,use_quota=True,user_id='37d23bf3208a479f8da5055709dbf19b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:07:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e328c43e-5e1f-4970-a068-8caef352eaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:07:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e328c43e-5e1f-4970-a068-8caef352eaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:07:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768a23a9-3e7f-4af6-abf7-1e582509dcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:07:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768a23a9-3e7f-4af6-abf7-1e582509dcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc652adb-23ce-40ab-93a0-799ca2e2fa2d', 'volume_name': 'volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:07:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a918f8-14cd-4e81-b3ed-07345f6430ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:07:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a918f8-14cd-4e81-b3ed-07345f6430ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:07:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f61236-a294-4b79-a415-a4a3849fc8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:07:15 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Volume fc652adb-23ce-40ab-93a0-799ca2e2fa2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d', 'volume_size': 1} Jul 14 13:07:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:07:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:07:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:07:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:07:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:07:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:07:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:07:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:16 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:07:16 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:16 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.321s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:07:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:07:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 28 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 13:07:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 13:07:25 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=64,cinder:INSERT=15,cinder:UPDATE=62,cinder:DELETE=4 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:07:25 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:UPDATE=50,cinder:DELETE=5,cinder:SELECT=64,cinder:INSERT=14 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:07:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-138ea24a-e5d0-4c04-ba46-1ed0b31a1ded tempest-VolumesActionsTest-1855850060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.156s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:07:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-138ea24a-e5d0-4c04-ba46-1ed0b31a1ded tempest-VolumesActionsTest-1855850060 None] Uploaded volume to glance image-id: eb8be177-5923-4c1c-982f-a36ba63f803b. {{(pid=86977) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 14 13:07:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.761s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:07:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1426600057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc652adb-23ce-40ab-93a0-799ca2e2fa2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67465275892d48d6af2b280d77b89569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:07:16Z,use_quota=True,user_id='37d23bf3208a479f8da5055709dbf19b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:07:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Creating volume fc652adb-23ce-40ab-93a0-799ca2e2fa2d {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:07:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:07:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:07:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:07:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:07:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:07:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:07:35 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:07:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:35 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-138ea24a-e5d0-4c04-ba46-1ed0b31a1ded tempest-VolumesActionsTest-1855850060 None] Copy volume to image completed successfully. Jul 14 13:07:35 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d 1073741824 Jul 14 13:07:35 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:35 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d 1073741824" returned: 0 in 0.457s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:36 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d Jul 14 13:07:36 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:36 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d" returned: 0 in 0.284s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:07:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:07:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f61236-a294-4b79-a415-a4a3849fc8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:07:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be7736e-ec20-4c0b-b391-d0c0c74a5738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:07:36 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Volume volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d (fc652adb-23ce-40ab-93a0-799ca2e2fa2d): created successfully Jul 14 13:07:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be7736e-ec20-4c0b-b391-d0c0c74a5738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:07:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Flow 'volume_create_manager' (907edc81-9d13-49b9-aa22-31e6537824f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:07:36 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-40d6efd0-32bc-4f28-815a-04f2240af5f9 tempest-VolumesSnapshotTestJSON-1172779126 None] Created volume successfully. Jul 14 13:07:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:07:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:07:37 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdde8c48-b640-46d2-83f8-4662fba96a35]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:07:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-03a4b6dc-99ff-4d24-add8-0c3f65383707 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:07:37 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 Jul 14 13:07:37 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:37 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851" returned: 0 in 0.403s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:37 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c96e42-19f6-428c-9760-0e83aa663950]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:07:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:38 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 Jul 14 13:07:38 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:38 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851" returned: 0 in 0.385s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 /opt/stack/data/cinder/conversion/4213ae03-5938-452a-ad7a-8ba95b189851.temp_image.47c6a894-7413-4c5f-8c94-7f01b069e5c4zsoeo4ek.img {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:38 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 /opt/stack/data/cinder/conversion/4213ae03-5938-452a-ad7a-8ba95b189851.temp_image.47c6a894-7413-4c5f-8c94-7f01b069e5c4zsoeo4ek.img Jul 14 13:07:38 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:42 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:07:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Flow 'volume_create_manager' (8e26c23c-4a25-441a-8888-793c609d19e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:07:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90987c2-2d59-4d24-9040-e3e2233ffbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:07:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90987c2-2d59-4d24-9040-e3e2233ffbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-137185499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3356c9d5-99f8-4b21-aa24-0e4197d2cdb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c1812d4a944f86aa9b7ca951b5ae79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:07:43Z,use_quota=True,user_id='ad4fd84a419d4a199be01d07e9452633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:07:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab0ebd4-6792-4538-84c8-b3fde43f87f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:07:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab0ebd4-6792-4538-84c8-b3fde43f87f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:07:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daec5cd6-b3ac-4f1c-ad36-af479ea1240d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:07:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daec5cd6-b3ac-4f1c-ad36-af479ea1240d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3356c9d5-99f8-4b21-aa24-0e4197d2cdb6', 'volume_name': 'volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:07:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02d09c7-7bdb-4779-95ca-a57228877602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:07:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02d09c7-7bdb-4779-95ca-a57228877602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:07:42 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2196062-bbb5-4ae5-a641-93f0f9de7e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:07:42 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Volume 3356c9d5-99f8-4b21-aa24-0e4197d2cdb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6', 'volume_size': 1} Jul 14 13:07:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:07:43 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 /opt/stack/data/cinder/conversion/4213ae03-5938-452a-ad7a-8ba95b189851.temp_image.47c6a894-7413-4c5f-8c94-7f01b069e5c4zsoeo4ek.img" returned: 0 in 4.895s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:43 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[513966ad-60c4-4ea2-ac4c-14d83a2bf305]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:07:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:43 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 Jul 14 13:07:43 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:43 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851" returned: 0 in 0.525s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:43 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] Image conversion details: src /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851, size 1024.00 MB, duration 4.90 sec, destination /opt/stack/data/cinder/conversion/4213ae03-5938-452a-ad7a-8ba95b189851.temp_image.47c6a894-7413-4c5f-8c94-7f01b069e5c4zsoeo4ek.img {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:07:43 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] Converted 1024.00 MB image at 209.14 MB/s Jul 14 13:07:43 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] 47c6a894-7413-4c5f-8c94-7f01b069e5c4 was raw, converting to qcow2 {{(pid=86977) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1195}} Jul 14 13:07:43 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bc07d8-64c3-47d4-b8b0-32aa581216bd]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:07:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4213ae03-5938-452a-ad7a-8ba95b189851.temp_image.47c6a894-7413-4c5f-8c94-7f01b069e5c4zsoeo4ek.img {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:43 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4213ae03-5938-452a-ad7a-8ba95b189851.temp_image.47c6a894-7413-4c5f-8c94-7f01b069e5c4zsoeo4ek.img Jul 14 13:07:43 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:44 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4213ae03-5938-452a-ad7a-8ba95b189851.temp_image.47c6a894-7413-4c5f-8c94-7f01b069e5c4zsoeo4ek.img" returned: 0 in 0.358s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4213ae03-5938-452a-ad7a-8ba95b189851.temp_image.47c6a894-7413-4c5f-8c94-7f01b069e5c4zsoeo4ek.img {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:44 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4213ae03-5938-452a-ad7a-8ba95b189851.temp_image.47c6a894-7413-4c5f-8c94-7f01b069e5c4zsoeo4ek.img Jul 14 13:07:44 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:44 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4213ae03-5938-452a-ad7a-8ba95b189851.temp_image.47c6a894-7413-4c5f-8c94-7f01b069e5c4zsoeo4ek.img" returned: 1 in 0.338s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4213ae03-5938-452a-ad7a-8ba95b189851.temp_image.47c6a894-7413-4c5f-8c94-7f01b069e5c4zsoeo4ek.img' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:07:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4213ae03-5938-452a-ad7a-8ba95b189851.temp_image.47c6a894-7413-4c5f-8c94-7f01b069e5c4zsoeo4ek.img /opt/stack/data/cinder/conversion/vol_upload_dl2dc3zk {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:44 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4213ae03-5938-452a-ad7a-8ba95b189851.temp_image.47c6a894-7413-4c5f-8c94-7f01b069e5c4zsoeo4ek.img /opt/stack/data/cinder/conversion/vol_upload_dl2dc3zk Jul 14 13:07:44 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:44 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4213ae03-5938-452a-ad7a-8ba95b189851.temp_image.47c6a894-7413-4c5f-8c94-7f01b069e5c4zsoeo4ek.img /opt/stack/data/cinder/conversion/vol_upload_dl2dc3zk" returned: 0 in 0.273s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:44 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] Image conversion details: src /opt/stack/data/cinder/conversion/4213ae03-5938-452a-ad7a-8ba95b189851.temp_image.47c6a894-7413-4c5f-8c94-7f01b069e5c4zsoeo4ek.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_dl2dc3zk {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:07:44 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 14 13:07:44 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[20679df7-8b50-4cd2-951b-d2de307e2806]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:07:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dl2dc3zk {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:44 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dl2dc3zk Jul 14 13:07:44 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:45 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dl2dc3zk" returned: 0 in 0.386s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.202s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:07:46 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] Uploaded volume to glance image-id: 47c6a894-7413-4c5f-8c94-7f01b069e5c4. {{(pid=86977) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 14 13:07:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-03a4b6dc-99ff-4d24-add8-0c3f65383707 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.149s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:07:46 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-03a4b6dc-99ff-4d24-add8-0c3f65383707 tempest-VolumesSnapshotTestJSON-1172779126 None] Creating offline snapshot f276e52c-f217-4fa6-b28d-0922d6421eab of volume fc652adb-23ce-40ab-93a0-799ca2e2fa2d {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:07:46 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-6c416763-f263-44f7-aa16-53be2a693a29 tempest-VolumesActionsTest-1855850060 None] Copy volume to image completed successfully. Jul 14 13:07:46 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84c0243-7c5f-4e51-8f2a-78d82ffd0db8]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:07:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-03a4b6dc-99ff-4d24-add8-0c3f65383707 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:46 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d Jul 14 13:07:46 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:47 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-03a4b6dc-99ff-4d24-add8-0c3f65383707 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d" returned: 0 in 0.403s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-03a4b6dc-99ff-4d24-add8-0c3f65383707 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:47 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab 1G Jul 14 13:07:47 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:47 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6874ef9d-5fb5-4fa2-8c23-389f25b2608e tempest-VolumesActionsTest-1855850060 None] Acquiring lock "cinder-4213ae03-5938-452a-ad7a-8ba95b189851-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:07:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-03a4b6dc-99ff-4d24-add8-0c3f65383707 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab 1G" returned: 0 in 0.735s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-03a4b6dc-99ff-4d24-add8-0c3f65383707 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6874ef9d-5fb5-4fa2-8c23-389f25b2608e tempest-VolumesActionsTest-1855850060 None] Lock "cinder-4213ae03-5938-452a-ad7a-8ba95b189851-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:07:47 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab Jul 14 13:07:47 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6874ef9d-5fb5-4fa2-8c23-389f25b2608e tempest-VolumesActionsTest-1855850060 None] Acquiring lock "cinder-quobyte-4213ae03-5938-452a-ad7a-8ba95b189851" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:07:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6874ef9d-5fb5-4fa2-8c23-389f25b2608e tempest-VolumesActionsTest-1855850060 None] Lock "cinder-quobyte-4213ae03-5938-452a-ad7a-8ba95b189851" acquired by "delete_volume" :: waited 0.028s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:07:48 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b445c5-bad5-4d55-b812-623ac224bf0f]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:07:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6874ef9d-5fb5-4fa2-8c23-389f25b2608e tempest-VolumesActionsTest-1855850060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:48 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 Jul 14 13:07:48 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:48 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-03a4b6dc-99ff-4d24-add8-0c3f65383707 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab" returned: 0 in 0.636s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:48 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-03a4b6dc-99ff-4d24-add8-0c3f65383707 tempest-VolumesSnapshotTestJSON-1172779126 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab is being set with open permissions: ugo+rw Jul 14 13:07:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-03a4b6dc-99ff-4d24-add8-0c3f65383707 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:48 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab Jul 14 13:07:48 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:48 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6874ef9d-5fb5-4fa2-8c23-389f25b2608e tempest-VolumesActionsTest-1855850060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851" returned: 0 in 0.649s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6874ef9d-5fb5-4fa2-8c23-389f25b2608e tempest-VolumesActionsTest-1855850060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:48 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851 Jul 14 13:07:48 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:48 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-03a4b6dc-99ff-4d24-add8-0c3f65383707 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab" returned: 0 in 0.459s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-03a4b6dc-99ff-4d24-add8-0c3f65383707 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:49 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.info Jul 14 13:07:49 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:49 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6874ef9d-5fb5-4fa2-8c23-389f25b2608e tempest-VolumesActionsTest-1855850060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4213ae03-5938-452a-ad7a-8ba95b189851" returned: 0 in 0.478s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6874ef9d-5fb5-4fa2-8c23-389f25b2608e tempest-VolumesActionsTest-1855850060 None] Lock "cinder-quobyte-4213ae03-5938-452a-ad7a-8ba95b189851" released by "delete_volume" :: held 1.208s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-6874ef9d-5fb5-4fa2-8c23-389f25b2608e tempest-VolumesActionsTest-1855850060 None] Created reservations ['9ccb3317-94fe-4855-a70e-0eb8c66bc165', 'f3f604c2-6ede-47a0-b17d-65ae16788b62', 'e77abe46-5649-4417-a6d5-c3fd3e1d13bd', '916f7946-5a72-4570-9ae6-3e0e7e8aa513'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6874ef9d-5fb5-4fa2-8c23-389f25b2608e tempest-VolumesActionsTest-1855850060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6874ef9d-5fb5-4fa2-8c23-389f25b2608e tempest-VolumesActionsTest-1855850060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6874ef9d-5fb5-4fa2-8c23-389f25b2608e tempest-VolumesActionsTest-1855850060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:07:49 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6874ef9d-5fb5-4fa2-8c23-389f25b2608e tempest-VolumesActionsTest-1855850060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6874ef9d-5fb5-4fa2-8c23-389f25b2608e tempest-VolumesActionsTest-1855850060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6874ef9d-5fb5-4fa2-8c23-389f25b2608e tempest-VolumesActionsTest-1855850060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-03a4b6dc-99ff-4d24-add8-0c3f65383707 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.info" returned: 0 in 0.354s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:49 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-03a4b6dc-99ff-4d24-add8-0c3f65383707 tempest-VolumesSnapshotTestJSON-1172779126 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.info is being set with open permissions: ugo+rw Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-03a4b6dc-99ff-4d24-add8-0c3f65383707 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:49 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:07:49 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:49 devstack sudo[100205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.info Jul 14 13:07:49 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:49 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6874ef9d-5fb5-4fa2-8c23-389f25b2608e tempest-VolumesActionsTest-1855850060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.345s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-6874ef9d-5fb5-4fa2-8c23-389f25b2608e tempest-VolumesActionsTest-1855850060 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:07:49 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-6874ef9d-5fb5-4fa2-8c23-389f25b2608e tempest-VolumesActionsTest-1855850060 None] Deleted volume successfully. Jul 14 13:07:49 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-03a4b6dc-99ff-4d24-add8-0c3f65383707 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.info" returned: 0 in 0.348s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-03a4b6dc-99ff-4d24-add8-0c3f65383707 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.071s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.802s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-137185499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3356c9d5-99f8-4b21-aa24-0e4197d2cdb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c1812d4a944f86aa9b7ca951b5ae79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:07:43Z,use_quota=True,user_id='ad4fd84a419d4a199be01d07e9452633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Creating volume 3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:07:49 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:49 devstack sudo[100211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 1073741824 Jul 14 13:07:49 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:49 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6874ef9d-5fb5-4fa2-8c23-389f25b2608e tempest-VolumesActionsTest-1855850060 None] Lock "cinder-4213ae03-5938-452a-ad7a-8ba95b189851-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:07:49 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-03a4b6dc-99ff-4d24-add8-0c3f65383707 tempest-VolumesSnapshotTestJSON-1172779126 None] Create snapshot completed successfully Jul 14 13:07:50 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 1073741824" returned: 0 in 0.521s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:50 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 Jul 14 13:07:50 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:50 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6" returned: 0 in 0.482s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:07:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:07:50 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2196062-bbb5-4ae5-a641-93f0f9de7e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:07:50 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65ba742-f2e9-45cc-8e50-02707c203002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:07:50 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Volume volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 (3356c9d5-99f8-4b21-aa24-0e4197d2cdb6): created successfully Jul 14 13:07:50 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65ba742-f2e9-45cc-8e50-02707c203002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:07:50 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Flow 'volume_create_manager' (8e26c23c-4a25-441a-8888-793c609d19e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:07:50 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-3017d186-2906-4089-a2f0-e333abe10227 tempest-TestStampPattern-831248066 None] Created volume successfully. Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Flow 'volume_create_manager' (ae740de1-5379-4985-a5d3-834d4e115ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf17b5d-22bd-498c-96ae-8628ec7213ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf17b5d-22bd-498c-96ae-8628ec7213ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-865302001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d834dbbf-5f9c-40b9-8362-224b51027cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67465275892d48d6af2b280d77b89569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f276e52c-f217-4fa6-b28d-0922d6421eab,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:07:51Z,use_quota=True,user_id='37d23bf3208a479f8da5055709dbf19b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d646abd2-ba78-41ee-8b5f-a079d5562e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d646abd2-ba78-41ee-8b5f-a079d5562e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c8b07a-3567-4838-84db-ac85c65045fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c8b07a-3567-4838-84db-ac85c65045fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd834dbbf-5f9c-40b9-8362-224b51027cf8', 'volume_name': 'volume-d834dbbf-5f9c-40b9-8362-224b51027cf8', 'volume_size': 1, 'snapshot_id': 'f276e52c-f217-4fa6-b28d-0922d6421eab'}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77df3e6b-3168-4d31-976a-3b687be448f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77df3e6b-3168-4d31-976a-3b687be448f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94cad87-f09e-4a53-8345-632b6186f183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:07:51 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Volume d834dbbf-5f9c-40b9-8362-224b51027cf8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d834dbbf-5f9c-40b9-8362-224b51027cf8', 'volume_size': 1, 'snapshot_id': 'f276e52c-f217-4fa6-b28d-0922d6421eab'} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-quobyte-f276e52c-f217-4fa6-b28d-0922d6421eab-d834dbbf-5f9c-40b9-8362-224b51027cf8" by "_create_volume_from_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-f276e52c-f217-4fa6-b28d-0922d6421eab-d834dbbf-5f9c-40b9-8362-224b51027cf8" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Creating volume d834dbbf-5f9c-40b9-8362-224b51027cf8 from snapshot f276e52c-f217-4fa6-b28d-0922d6421eab {{(pid=86977) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-quobyte-d834dbbf-5f9c-40b9-8362-224b51027cf8" by "_copy_volume_from_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-d834dbbf-5f9c-40b9-8362-224b51027cf8" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] snapshot: f276e52c-f217-4fa6-b28d-0922d6421eab, volume: d834dbbf-5f9c-40b9-8362-224b51027cf8, {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ae00bc-4f3d-40ea-b82b-5c4af2f3d10b]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:07:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:51 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab Jul 14 13:07:51 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:52 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab" returned: 0 in 0.681s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:07:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 13:07:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Creating direct copy from snapshot {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 13:07:52 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[887ae303-fe01-40fd-ae2f-e6b72e0a10d1]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:07:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:52 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d Jul 14 13:07:52 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:52 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Jul 14 13:07:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d" returned: 0 in 0.499s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:07:52 devstack cinder-volume[86977]: DEBUG cinder.utils [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Path /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d834dbbf-5f9c-40b9-8362-224b51027cf8 not found in is_blk_device check {{(pid=86977) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 13:07:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d834dbbf-5f9c-40b9-8362-224b51027cf8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:07:52 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d834dbbf-5f9c-40b9-8362-224b51027cf8 Jul 14 13:07:52 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:07:59 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d834dbbf-5f9c-40b9-8362-224b51027cf8" returned: 0 in 7.257s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:00 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49e1ed3-f479-4619-a1ec-9220615d1ba1]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:00 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d Jul 14 13:08:00 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:00 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d" returned: 0 in 0.594s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:00 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Image conversion details: src /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d, size 1024.00 MB, duration 7.26 sec, destination /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d834dbbf-5f9c-40b9-8362-224b51027cf8 {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:08:00 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Converted 1024.00 MB image at 141.07 MB/s Jul 14 13:08:00 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d834dbbf-5f9c-40b9-8362-224b51027cf8 is being set with open permissions: ugo+rw Jul 14 13:08:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d834dbbf-5f9c-40b9-8362-224b51027cf8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:00 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d834dbbf-5f9c-40b9-8362-224b51027cf8 Jul 14 13:08:00 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:00 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d834dbbf-5f9c-40b9-8362-224b51027cf8" returned: 0 in 0.275s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-d834dbbf-5f9c-40b9-8362-224b51027cf8" released by "_copy_volume_from_snapshot" :: held 9.456s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-f276e52c-f217-4fa6-b28d-0922d6421eab-d834dbbf-5f9c-40b9-8362-224b51027cf8" released by "_create_volume_from_snapshot" :: held 9.505s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.539s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94cad87-f09e-4a53-8345-632b6186f183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d834dbbf-5f9c-40b9-8362-224b51027cf8', 'volume_size': 1, 'snapshot_id': 'f276e52c-f217-4fa6-b28d-0922d6421eab'}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9309867f-196b-4078-bb24-b3cc4fa0bcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:00 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Volume volume-d834dbbf-5f9c-40b9-8362-224b51027cf8 (d834dbbf-5f9c-40b9-8362-224b51027cf8): created successfully Jul 14 13:08:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9309867f-196b-4078-bb24-b3cc4fa0bcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Flow 'volume_create_manager' (ae740de1-5379-4985-a5d3-834d4e115ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:08:01 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c1b45cb1-793d-48d5-89a2-63879c8fb1b9 tempest-VolumesSnapshotTestJSON-1172779126 None] Created volume successfully. Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-9f0f2acd-3da1-4c21-be58-ac3d543c0aef tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-d834dbbf-5f9c-40b9-8362-224b51027cf8-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-9f0f2acd-3da1-4c21-be58-ac3d543c0aef tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-d834dbbf-5f9c-40b9-8362-224b51027cf8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-9f0f2acd-3da1-4c21-be58-ac3d543c0aef tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-quobyte-d834dbbf-5f9c-40b9-8362-224b51027cf8" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-9f0f2acd-3da1-4c21-be58-ac3d543c0aef tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-d834dbbf-5f9c-40b9-8362-224b51027cf8" acquired by "delete_volume" :: waited 0.024s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8a4c55-c336-480e-89c0-d7ec35c21092]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9f0f2acd-3da1-4c21-be58-ac3d543c0aef tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d834dbbf-5f9c-40b9-8362-224b51027cf8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:08:01 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d834dbbf-5f9c-40b9-8362-224b51027cf8 Jul 14 13:08:01 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Flow 'volume_create_manager' (296b23bc-ded8-407a-ba59-293f9e21ad16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6601ed9a-c823-4fdf-8dca-d9734ed6e26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6601ed9a-c823-4fdf-8dca-d9734ed6e26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-541454025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57854770-7e20-47d8-9e06-9f3cad18ce9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='153d947c3f5b4a8486c63389351adcf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:08:02Z,use_quota=True,user_id='61c606aa935e4f0fab382cb8f26f8775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a1d4bb-2eb8-4a38-87e1-f66961515acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a1d4bb-2eb8-4a38-87e1-f66961515acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbdcaad9-b2e1-49e5-9e28-df0fb12d3571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbdcaad9-b2e1-49e5-9e28-df0fb12d3571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57854770-7e20-47d8-9e06-9f3cad18ce9f', 'volume_name': 'volume-57854770-7e20-47d8-9e06-9f3cad18ce9f', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (492df118-ebbe-45d1-bc7c-20e570bb07d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (492df118-ebbe-45d1-bc7c-20e570bb07d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce495ee-5d65-4527-8a7e-8aba06865f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:01 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Volume 57854770-7e20-47d8-9e06-9f3cad18ce9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57854770-7e20-47d8-9e06-9f3cad18ce9f', 'volume_size': 1} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-541454025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57854770-7e20-47d8-9e06-9f3cad18ce9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='153d947c3f5b4a8486c63389351adcf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:08:02Z,use_quota=True,user_id='61c606aa935e4f0fab382cb8f26f8775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Creating volume 57854770-7e20-47d8-9e06-9f3cad18ce9f {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:08:01 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:08:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:01 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f 1073741824 Jul 14 13:08:01 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:02 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9f0f2acd-3da1-4c21-be58-ac3d543c0aef tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d834dbbf-5f9c-40b9-8362-224b51027cf8" returned: 0 in 0.390s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9f0f2acd-3da1-4c21-be58-ac3d543c0aef tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d834dbbf-5f9c-40b9-8362-224b51027cf8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:02 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d834dbbf-5f9c-40b9-8362-224b51027cf8 Jul 14 13:08:02 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:02 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:02 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9f0f2acd-3da1-4c21-be58-ac3d543c0aef tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-d834dbbf-5f9c-40b9-8362-224b51027cf8" returned: 0 in 0.284s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f 1073741824" returned: 0 in 0.472s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-9f0f2acd-3da1-4c21-be58-ac3d543c0aef tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-d834dbbf-5f9c-40b9-8362-224b51027cf8" released by "delete_volume" :: held 0.738s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:02 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f Jul 14 13:08:02 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-9f0f2acd-3da1-4c21-be58-ac3d543c0aef tempest-VolumesSnapshotTestJSON-1172779126 None] Created reservations ['3d1e0baf-38a1-4ec4-8b69-aba9aed26d6a', '102c90c4-7514-4785-82a2-b5f0a1d79e36', '79782e80-8a21-43b3-8421-d11290f9cad4', '7e339e59-e6a2-4a50-9422-ab878c424a06'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9f0f2acd-3da1-4c21-be58-ac3d543c0aef tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9f0f2acd-3da1-4c21-be58-ac3d543c0aef tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9f0f2acd-3da1-4c21-be58-ac3d543c0aef tempest-VolumesSnapshotTestJSON-1172779126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9f0f2acd-3da1-4c21-be58-ac3d543c0aef tempest-VolumesSnapshotTestJSON-1172779126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9f0f2acd-3da1-4c21-be58-ac3d543c0aef tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9f0f2acd-3da1-4c21-be58-ac3d543c0aef tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:02 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:08:02 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:02 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f" returned: 0 in 0.290s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce495ee-5d65-4527-8a7e-8aba06865f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57854770-7e20-47d8-9e06-9f3cad18ce9f', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf249428-8250-4905-a219-97dba55711d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:02 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Volume volume-57854770-7e20-47d8-9e06-9f3cad18ce9f (57854770-7e20-47d8-9e06-9f3cad18ce9f): created successfully Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf249428-8250-4905-a219-97dba55711d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Flow 'volume_create_manager' (296b23bc-ded8-407a-ba59-293f9e21ad16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7233b21a-6b9c-416c-a1a9-27a9dd92c666 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-f276e52c-f217-4fa6-b28d-0922d6421eab-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:02 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-0aab6e1c-e5e0-45e6-afa0-55ebb6903527 tempest-VolumesCloneTest-1260869160 None] Created volume successfully. Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7233b21a-6b9c-416c-a1a9-27a9dd92c666 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-f276e52c-f217-4fa6-b28d-0922d6421eab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7233b21a-6b9c-416c-a1a9-27a9dd92c666 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-quobyte-fc652adb-23ce-40ab-93a0-799ca2e2fa2d" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7233b21a-6b9c-416c-a1a9-27a9dd92c666 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-fc652adb-23ce-40ab-93a0-799ca2e2fa2d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7233b21a-6b9c-416c-a1a9-27a9dd92c666 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-quobyte-f276e52c-f217-4fa6-b28d-0922d6421eab" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:02 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9f0f2acd-3da1-4c21-be58-ac3d543c0aef tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.315s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-9f0f2acd-3da1-4c21-be58-ac3d543c0aef tempest-VolumesSnapshotTestJSON-1172779126 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:08:02 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-9f0f2acd-3da1-4c21-be58-ac3d543c0aef tempest-VolumesSnapshotTestJSON-1172779126 None] Deleted volume successfully. Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7233b21a-6b9c-416c-a1a9-27a9dd92c666 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-f276e52c-f217-4fa6-b28d-0922d6421eab" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-7233b21a-6b9c-416c-a1a9-27a9dd92c666 tempest-VolumesSnapshotTestJSON-1172779126 None] Deleting offline snapshot f276e52c-f217-4fa6-b28d-0922d6421eab of volume fc652adb-23ce-40ab-93a0-799ca2e2fa2d {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-7233b21a-6b9c-416c-a1a9-27a9dd92c666 tempest-VolumesSnapshotTestJSON-1172779126 None] snapshot_file for this snap is: volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-9f0f2acd-3da1-4c21-be58-ac3d543c0aef tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-d834dbbf-5f9c-40b9-8362-224b51027cf8-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a11518-6bb7-4699-8eb4-8c4e081d8409]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7233b21a-6b9c-416c-a1a9-27a9dd92c666 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:03 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab Jul 14 13:08:03 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:03 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7233b21a-6b9c-416c-a1a9-27a9dd92c666 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab" returned: 0 in 0.355s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-7233b21a-6b9c-416c-a1a9-27a9dd92c666 tempest-VolumesSnapshotTestJSON-1172779126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:08:03 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c328f2d-55d2-4db6-a506-d3f5c6ccbdaa]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7233b21a-6b9c-416c-a1a9-27a9dd92c666 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:03 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d Jul 14 13:08:03 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:03 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7233b21a-6b9c-416c-a1a9-27a9dd92c666 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d" returned: 0 in 0.360s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7233b21a-6b9c-416c-a1a9-27a9dd92c666 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:03 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab Jul 14 13:08:03 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:03 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7233b21a-6b9c-416c-a1a9-27a9dd92c666 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab" returned: 0 in 0.341s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7233b21a-6b9c-416c-a1a9-27a9dd92c666 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:04 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab Jul 14 13:08:04 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:04 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7233b21a-6b9c-416c-a1a9-27a9dd92c666 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d.f276e52c-f217-4fa6-b28d-0922d6421eab" returned: 0 in 0.289s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7233b21a-6b9c-416c-a1a9-27a9dd92c666 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-f276e52c-f217-4fa6-b28d-0922d6421eab" released by "_delete_snapshot" :: held 1.449s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7233b21a-6b9c-416c-a1a9-27a9dd92c666 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-fc652adb-23ce-40ab-93a0-799ca2e2fa2d" released by "delete_snapshot" :: held 1.485s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Flow 'volume_create_manager' (20b11f2e-51a7-4550-9bb2-1eb789d83f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d6cf66-5e2e-43ca-9a98-881fbc4fa736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-7233b21a-6b9c-416c-a1a9-27a9dd92c666 tempest-VolumesSnapshotTestJSON-1172779126 None] Created reservations ['415a5f60-7117-4c12-95d8-267e9d8a0d79', 'ef077360-de91-4baf-a424-6a88aaaada3b', 'ded63fca-c581-4957-a8e1-aef494c3d087', 'da6c5baa-4c3a-40ae-bd8a-6c1b9457cc99'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d6cf66-5e2e-43ca-9a98-881fbc4fa736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2094894238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4bda95-cbaf-429e-9394-a0aeca269fac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='153d947c3f5b4a8486c63389351adcf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:08:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=57854770-7e20-47d8-9e06-9f3cad18ce9f,status='creating',terminated_at=None,updated_at=2026-07-14T11:08:04Z,use_quota=True,user_id='61c606aa935e4f0fab382cb8f26f8775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97a7f7a-466a-4a75-8cc5-a798249e56e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97a7f7a-466a-4a75-8cc5-a798249e56e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508dc681-a1ae-4800-823b-2cd89ae9e821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508dc681-a1ae-4800-823b-2cd89ae9e821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'df4bda95-cbaf-429e-9394-a0aeca269fac', 'volume_name': 'volume-df4bda95-cbaf-429e-9394-a0aeca269fac', 'volume_size': 2, 'source_volid': '57854770-7e20-47d8-9e06-9f3cad18ce9f', 'source_volstatus': 'available'}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c844fb-ae60-4fad-a76c-c2b089d3914e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c844fb-ae60-4fad-a76c-c2b089d3914e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2ecba9-f416-4fdf-8773-eb00155aa123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:04 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Volume df4bda95-cbaf-429e-9394-a0aeca269fac: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-df4bda95-cbaf-429e-9394-a0aeca269fac', 'volume_size': 2, 'source_volid': '57854770-7e20-47d8-9e06-9f3cad18ce9f', 'source_volstatus': 'available'} Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:04 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Cloning volume 57854770-7e20-47d8-9e06-9f3cad18ce9f to volume df4bda95-cbaf-429e-9394-a0aeca269fac Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Creating offline snapshot aa3c5fdb-6d6a-4026-9f56-66644402e2f3 of volume 57854770-7e20-47d8-9e06-9f3cad18ce9f {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:08:04 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-7233b21a-6b9c-416c-a1a9-27a9dd92c666 tempest-VolumesSnapshotTestJSON-1172779126 None] Delete snapshot completed successfully. Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-7233b21a-6b9c-416c-a1a9-27a9dd92c666 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-f276e52c-f217-4fa6-b28d-0922d6421eab-delete_snapshot" released by "delete_snapshot" :: held 1.768s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e23330c-a974-403f-b409-91f25e0fedc4]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:04 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f Jul 14 13:08:04 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:04 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f" returned: 0 in 0.356s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:04 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3 1G Jul 14 13:08:04 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:05 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-52b9fdb0-eaa1-4b1f-81e4-0cbd6e0b79a8 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-fc652adb-23ce-40ab-93a0-799ca2e2fa2d-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:05 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-52b9fdb0-eaa1-4b1f-81e4-0cbd6e0b79a8 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-fc652adb-23ce-40ab-93a0-799ca2e2fa2d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:05 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-52b9fdb0-eaa1-4b1f-81e4-0cbd6e0b79a8 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-quobyte-fc652adb-23ce-40ab-93a0-799ca2e2fa2d" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:05 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-52b9fdb0-eaa1-4b1f-81e4-0cbd6e0b79a8 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-fc652adb-23ce-40ab-93a0-799ca2e2fa2d" acquired by "delete_volume" :: waited 0.015s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:05 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf0c8a5-4a39-44b0-81b5-d0f7317eeb92]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-52b9fdb0-eaa1-4b1f-81e4-0cbd6e0b79a8 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:05 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d Jul 14 13:08:05 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:05 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3 1G" returned: 0 in 0.437s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57854770-7e20-47d8-9e06-9f3cad18ce9f -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:05 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57854770-7e20-47d8-9e06-9f3cad18ce9f -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3 Jul 14 13:08:05 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:05 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-52b9fdb0-eaa1-4b1f-81e4-0cbd6e0b79a8 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d" returned: 0 in 0.384s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-52b9fdb0-eaa1-4b1f-81e4-0cbd6e0b79a8 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:05 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d Jul 14 13:08:05 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:05 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57854770-7e20-47d8-9e06-9f3cad18ce9f -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3" returned: 0 in 0.325s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:05 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3 is being set with open permissions: ugo+rw Jul 14 13:08:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:05 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3 Jul 14 13:08:05 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:05 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-52b9fdb0-eaa1-4b1f-81e4-0cbd6e0b79a8 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fc652adb-23ce-40ab-93a0-799ca2e2fa2d" returned: 0 in 0.281s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:05 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-52b9fdb0-eaa1-4b1f-81e4-0cbd6e0b79a8 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-fc652adb-23ce-40ab-93a0-799ca2e2fa2d" released by "delete_volume" :: held 0.726s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:05 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-52b9fdb0-eaa1-4b1f-81e4-0cbd6e0b79a8 tempest-VolumesSnapshotTestJSON-1172779126 None] Created reservations ['9f6160ad-947e-4167-aa96-f9bc1f88f17b', '46a9d398-74ed-47b9-93bc-0412c07a68ab', '2f6f8429-e639-4712-87d0-618d94909df5', '33930546-7a65-4475-9549-1a668065bc5e'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:08:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-52b9fdb0-eaa1-4b1f-81e4-0cbd6e0b79a8 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-52b9fdb0-eaa1-4b1f-81e4-0cbd6e0b79a8 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-52b9fdb0-eaa1-4b1f-81e4-0cbd6e0b79a8 tempest-VolumesSnapshotTestJSON-1172779126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:08:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-52b9fdb0-eaa1-4b1f-81e4-0cbd6e0b79a8 tempest-VolumesSnapshotTestJSON-1172779126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:08:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-52b9fdb0-eaa1-4b1f-81e4-0cbd6e0b79a8 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-52b9fdb0-eaa1-4b1f-81e4-0cbd6e0b79a8 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:05 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:08:05 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:05 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3" returned: 0 in 0.266s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:06 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.info Jul 14 13:08:06 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:06 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-52b9fdb0-eaa1-4b1f-81e4-0cbd6e0b79a8 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.277s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-52b9fdb0-eaa1-4b1f-81e4-0cbd6e0b79a8 tempest-VolumesSnapshotTestJSON-1172779126 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:08:06 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-52b9fdb0-eaa1-4b1f-81e4-0cbd6e0b79a8 tempest-VolumesSnapshotTestJSON-1172779126 None] Deleted volume successfully. Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-52b9fdb0-eaa1-4b1f-81e4-0cbd6e0b79a8 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-fc652adb-23ce-40ab-93a0-799ca2e2fa2d-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-560da068-f6a6-42cb-8947-b7708628acd8 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-45549954-7832-49a4-ba90-8103457a7344-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:06 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-560da068-f6a6-42cb-8947-b7708628acd8 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-45549954-7832-49a4-ba90-8103457a7344-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.info" returned: 0 in 0.282s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:06 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.info is being set with open permissions: ugo+rw Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:06 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.info Jul 14 13:08:06 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-560da068-f6a6-42cb-8947-b7708628acd8 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "cinder-quobyte-45549954-7832-49a4-ba90-8103457a7344" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-560da068-f6a6-42cb-8947-b7708628acd8 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-45549954-7832-49a4-ba90-8103457a7344" acquired by "delete_volume" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0dbef8-ab9e-436a-8820-9ed129c79f9c]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-560da068-f6a6-42cb-8947-b7708628acd8 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:06 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344 Jul 14 13:08:06 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:06 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.info" returned: 0 in 0.256s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Acquiring lock "cinder-quobyte-df4bda95-cbaf-429e-9394-a0aeca269fac" by "_copy_volume_from_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Lock "cinder-quobyte-df4bda95-cbaf-429e-9394-a0aeca269fac" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] snapshot: aa3c5fdb-6d6a-4026-9f56-66644402e2f3, volume: df4bda95-cbaf-429e-9394-a0aeca269fac, {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd37ec3-63d9-461c-9e5f-ee856c769174]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:06 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3 Jul 14 13:08:06 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:06 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-560da068-f6a6-42cb-8947-b7708628acd8 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344" returned: 0 in 0.370s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-560da068-f6a6-42cb-8947-b7708628acd8 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:06 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344 Jul 14 13:08:06 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:06 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3" returned: 0 in 0.363s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57854770-7e20-47d8-9e06-9f3cad18ce9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 13:08:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Creating direct copy from snapshot {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 13:08:07 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[377c229d-1c31-47ab-81c9-8e048f797f60]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:07 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-560da068-f6a6-42cb-8947-b7708628acd8 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-45549954-7832-49a4-ba90-8103457a7344" returned: 0 in 0.247s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-560da068-f6a6-42cb-8947-b7708628acd8 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-quobyte-45549954-7832-49a4-ba90-8103457a7344" released by "delete_volume" :: held 0.689s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:07 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-560da068-f6a6-42cb-8947-b7708628acd8 tempest-VolumesSnapshotTestJSON-1172779126 None] Created reservations ['35bb99e3-0145-452a-85e3-8abb7fba7379', '12d4983c-5a0c-4641-b50b-9fb1ab5dd9f1', 'e19cc8fd-7e4d-4fbd-b5e8-0b6819b54705', '841adbf1-5bc5-44a3-a529-db5705909473'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:08:07 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f Jul 14 13:08:07 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-560da068-f6a6-42cb-8947-b7708628acd8 tempest-VolumesSnapshotTestJSON-1172779126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-560da068-f6a6-42cb-8947-b7708628acd8 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:07 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-560da068-f6a6-42cb-8947-b7708628acd8 tempest-VolumesSnapshotTestJSON-1172779126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:08:07 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-560da068-f6a6-42cb-8947-b7708628acd8 tempest-VolumesSnapshotTestJSON-1172779126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:08:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-560da068-f6a6-42cb-8947-b7708628acd8 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-560da068-f6a6-42cb-8947-b7708628acd8 tempest-VolumesSnapshotTestJSON-1172779126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:07 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:08:07 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:07 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f" returned: 0 in 0.399s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:07 devstack cinder-volume[86977]: DEBUG cinder.utils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Path /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-df4bda95-cbaf-429e-9394-a0aeca269fac not found in is_blk_device check {{(pid=86977) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 13:08:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-df4bda95-cbaf-429e-9394-a0aeca269fac {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:07 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-560da068-f6a6-42cb-8947-b7708628acd8 tempest-VolumesSnapshotTestJSON-1172779126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.254s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:07 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-560da068-f6a6-42cb-8947-b7708628acd8 tempest-VolumesSnapshotTestJSON-1172779126 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:08:07 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-560da068-f6a6-42cb-8947-b7708628acd8 tempest-VolumesSnapshotTestJSON-1172779126 None] Deleted volume successfully. Jul 14 13:08:07 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-df4bda95-cbaf-429e-9394-a0aeca269fac Jul 14 13:08:07 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-560da068-f6a6-42cb-8947-b7708628acd8 tempest-VolumesSnapshotTestJSON-1172779126 None] Lock "cinder-45549954-7832-49a4-ba90-8103457a7344-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:12 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-df4bda95-cbaf-429e-9394-a0aeca269fac" returned: 0 in 5.334s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:12 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fdd629-36a7-4fd9-8427-ede827ad4a1e]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:12 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f Jul 14 13:08:12 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:13 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f" returned: 0 in 0.598s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:13 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Image conversion details: src /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f, size 1024.00 MB, duration 5.34 sec, destination /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-df4bda95-cbaf-429e-9394-a0aeca269fac {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:08:13 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Converted 1024.00 MB image at 191.94 MB/s Jul 14 13:08:13 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-df4bda95-cbaf-429e-9394-a0aeca269fac is being set with open permissions: ugo+rw Jul 14 13:08:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-df4bda95-cbaf-429e-9394-a0aeca269fac {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:13 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-df4bda95-cbaf-429e-9394-a0aeca269fac Jul 14 13:08:13 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:13 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-df4bda95-cbaf-429e-9394-a0aeca269fac" returned: 0 in 0.259s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Lock "cinder-quobyte-df4bda95-cbaf-429e-9394-a0aeca269fac" released by "_copy_volume_from_snapshot" :: held 7.043s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Acquiring lock "cinder-quobyte-aa3c5fdb-6d6a-4026-9f56-66644402e2f3" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Lock "cinder-quobyte-aa3c5fdb-6d6a-4026-9f56-66644402e2f3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Deleting offline snapshot aa3c5fdb-6d6a-4026-9f56-66644402e2f3 of volume 57854770-7e20-47d8-9e06-9f3cad18ce9f {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:08:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] snapshot_file for this snap is: volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:08:13 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24a8eec-07ee-4639-99aa-2608ca6cccde]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:13 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3 Jul 14 13:08:13 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:14 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3" returned: 0 in 0.402s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57854770-7e20-47d8-9e06-9f3cad18ce9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:08:14 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[8012daba-260a-4a08-a829-6b1b6221ac54]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:14 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f Jul 14 13:08:14 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:14 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f" returned: 0 in 0.401s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:14 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3 Jul 14 13:08:14 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:14 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3" returned: 0 in 0.338s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:14 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3 Jul 14 13:08:14 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:15 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f.aa3c5fdb-6d6a-4026-9f56-66644402e2f3" returned: 0 in 0.248s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Lock "cinder-quobyte-aa3c5fdb-6d6a-4026-9f56-66644402e2f3" released by "_delete_snapshot" :: held 1.482s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.641s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2ecba9-f416-4fdf-8773-eb00155aa123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df4bda95-cbaf-429e-9394-a0aeca269fac', 'volume_size': 2, 'source_volid': '57854770-7e20-47d8-9e06-9f3cad18ce9f', 'source_volstatus': 'available'}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (757c33e5-970e-4b3d-9b84-2de1c4afbf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:15 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Volume volume-df4bda95-cbaf-429e-9394-a0aeca269fac (df4bda95-cbaf-429e-9394-a0aeca269fac): created successfully Jul 14 13:08:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (757c33e5-970e-4b3d-9b84-2de1c4afbf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Flow 'volume_create_manager' (20b11f2e-51a7-4550-9bb2-1eb789d83f01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:08:15 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-40993da3-245a-402f-9a50-a067ccbd68e5 tempest-VolumesCloneTest-1260869160 None] Created volume successfully. Jul 14 13:08:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0ff0129f-bfe5-4a21-a990-5be6cca22573 tempest-VolumesCloneTest-1260869160 None] Acquiring lock "cinder-df4bda95-cbaf-429e-9394-a0aeca269fac-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0ff0129f-bfe5-4a21-a990-5be6cca22573 tempest-VolumesCloneTest-1260869160 None] Lock "cinder-df4bda95-cbaf-429e-9394-a0aeca269fac-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0ff0129f-bfe5-4a21-a990-5be6cca22573 tempest-VolumesCloneTest-1260869160 None] Acquiring lock "cinder-quobyte-df4bda95-cbaf-429e-9394-a0aeca269fac" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0ff0129f-bfe5-4a21-a990-5be6cca22573 tempest-VolumesCloneTest-1260869160 None] Lock "cinder-quobyte-df4bda95-cbaf-429e-9394-a0aeca269fac" acquired by "delete_volume" :: waited 0.027s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:15 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7fcff2-6777-4f9f-85a7-9108d8e6a712]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0ff0129f-bfe5-4a21-a990-5be6cca22573 tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-df4bda95-cbaf-429e-9394-a0aeca269fac {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:15 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-df4bda95-cbaf-429e-9394-a0aeca269fac Jul 14 13:08:15 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:16 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0ff0129f-bfe5-4a21-a990-5be6cca22573 tempest-VolumesCloneTest-1260869160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-df4bda95-cbaf-429e-9394-a0aeca269fac" returned: 0 in 0.411s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0ff0129f-bfe5-4a21-a990-5be6cca22573 tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-df4bda95-cbaf-429e-9394-a0aeca269fac {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:16 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-df4bda95-cbaf-429e-9394-a0aeca269fac Jul 14 13:08:16 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Flow 'volume_create_manager' (571bdd4a-2779-45dc-85fc-cd0421f2b6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503c7c98-b419-4c40-a6be-fa09a0284b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503c7c98-b419-4c40-a6be-fa09a0284b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1391257447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ece0ca6-351d-46ae-826f-ed13d308ac0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26a6eee391e44d0a3c214f3dcb80387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:08:16Z,use_quota=True,user_id='f4b918a4d5794b5bae0f72db47b83a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96695786-cf85-43d3-bb23-7d5f17bd3dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96695786-cf85-43d3-bb23-7d5f17bd3dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea6c4fad-e4fc-489a-9512-999a914010dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea6c4fad-e4fc-489a-9512-999a914010dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ece0ca6-351d-46ae-826f-ed13d308ac0e', 'volume_name': 'volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bc1f70-b009-46cf-a383-bc30a47852db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bc1f70-b009-46cf-a383-bc30a47852db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc9a839-f231-43f6-adf3-036817624725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:16 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Volume 4ece0ca6-351d-46ae-826f-ed13d308ac0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e', 'volume_size': 1} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1391257447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ece0ca6-351d-46ae-826f-ed13d308ac0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26a6eee391e44d0a3c214f3dcb80387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:08:16Z,use_quota=True,user_id='f4b918a4d5794b5bae0f72db47b83a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Creating volume 4ece0ca6-351d-46ae-826f-ed13d308ac0e {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:08:16 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:16 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0ff0129f-bfe5-4a21-a990-5be6cca22573 tempest-VolumesCloneTest-1260869160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-df4bda95-cbaf-429e-9394-a0aeca269fac" returned: 0 in 0.314s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:16 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e 1073741824 Jul 14 13:08:16 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0ff0129f-bfe5-4a21-a990-5be6cca22573 tempest-VolumesCloneTest-1260869160 None] Lock "cinder-quobyte-df4bda95-cbaf-429e-9394-a0aeca269fac" released by "delete_volume" :: held 0.801s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:16 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:08:16 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-0ff0129f-bfe5-4a21-a990-5be6cca22573 tempest-VolumesCloneTest-1260869160 None] Created reservations ['556eaf0a-b88f-4372-bec1-3a7d22b6d793', '1163192c-34e6-4243-a1d8-19d3e7a0564c', '1abf7674-07e7-4457-925a-33577a584b7b', '0d7be78b-9df8-442a-874d-7a6057f33d0f'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0ff0129f-bfe5-4a21-a990-5be6cca22573 tempest-VolumesCloneTest-1260869160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0ff0129f-bfe5-4a21-a990-5be6cca22573 tempest-VolumesCloneTest-1260869160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0ff0129f-bfe5-4a21-a990-5be6cca22573 tempest-VolumesCloneTest-1260869160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0ff0129f-bfe5-4a21-a990-5be6cca22573 tempest-VolumesCloneTest-1260869160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0ff0129f-bfe5-4a21-a990-5be6cca22573 tempest-VolumesCloneTest-1260869160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0ff0129f-bfe5-4a21-a990-5be6cca22573 tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:16 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:08:16 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:16 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.338s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 28 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-e575ef78-a16e-4cfb-96bb-90002ff21970 req-5c2a332e-658a-480a-a56f-8e5b20102ff8 tempest-TestStampPattern-831248066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-61c81d1e-fafc-4b97-801f-6fd1f327871e tempest-VolumesCloneTest-1260869160 None] Acquiring lock "cinder-57854770-7e20-47d8-9e06-9f3cad18ce9f-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-61c81d1e-fafc-4b97-801f-6fd1f327871e tempest-VolumesCloneTest-1260869160 None] Lock "cinder-57854770-7e20-47d8-9e06-9f3cad18ce9f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-61c81d1e-fafc-4b97-801f-6fd1f327871e tempest-VolumesCloneTest-1260869160 None] Acquiring lock "cinder-quobyte-57854770-7e20-47d8-9e06-9f3cad18ce9f" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-61c81d1e-fafc-4b97-801f-6fd1f327871e tempest-VolumesCloneTest-1260869160 None] Lock "cinder-quobyte-57854770-7e20-47d8-9e06-9f3cad18ce9f" acquired by "delete_volume" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[027a1d9d-a6c8-4590-90d8-9e5822f3f66a]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-61c81d1e-fafc-4b97-801f-6fd1f327871e tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:17 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0ff0129f-bfe5-4a21-a990-5be6cca22573 tempest-VolumesCloneTest-1260869160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.357s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-0ff0129f-bfe5-4a21-a990-5be6cca22573 tempest-VolumesCloneTest-1260869160 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:08:17 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-0ff0129f-bfe5-4a21-a990-5be6cca22573 tempest-VolumesCloneTest-1260869160 None] Deleted volume successfully. Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0ff0129f-bfe5-4a21-a990-5be6cca22573 tempest-VolumesCloneTest-1260869160 None] Lock "cinder-df4bda95-cbaf-429e-9394-a0aeca269fac-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:17 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e 1073741824" returned: 0 in 0.632s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:17 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e Jul 14 13:08:17 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:17 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f Jul 14 13:08:17 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:17 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e" returned: 0 in 0.271s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-e575ef78-a16e-4cfb-96bb-90002ff21970 req-5c2a332e-658a-480a-a56f-8e5b20102ff8 tempest-TestStampPattern-831248066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.526s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc9a839-f231-43f6-adf3-036817624725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329c50d6-5e1b-4dcc-9ef7-f2ade5f2b052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d16c9e-09e2-4b2c-b804-0eec357a2bb9]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-e575ef78-a16e-4cfb-96bb-90002ff21970 req-5c2a332e-658a-480a-a56f-8e5b20102ff8 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:17 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-61c81d1e-fafc-4b97-801f-6fd1f327871e tempest-VolumesCloneTest-1260869160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f" returned: 0 in 0.398s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-61c81d1e-fafc-4b97-801f-6fd1f327871e tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:17 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Volume volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e (4ece0ca6-351d-46ae-826f-ed13d308ac0e): created successfully Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329c50d6-5e1b-4dcc-9ef7-f2ade5f2b052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:17 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f Jul 14 13:08:17 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Flow 'volume_create_manager' (571bdd4a-2779-45dc-85fc-cd0421f2b6d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:08:17 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e72f9b37-d57d-422d-b920-92a436137db9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Created volume successfully. Jul 14 13:08:17 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 Jul 14 13:08:17 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:17 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-61c81d1e-fafc-4b97-801f-6fd1f327871e tempest-VolumesCloneTest-1260869160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-57854770-7e20-47d8-9e06-9f3cad18ce9f" returned: 0 in 0.289s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-61c81d1e-fafc-4b97-801f-6fd1f327871e tempest-VolumesCloneTest-1260869160 None] Lock "cinder-quobyte-57854770-7e20-47d8-9e06-9f3cad18ce9f" released by "delete_volume" :: held 0.748s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-61c81d1e-fafc-4b97-801f-6fd1f327871e tempest-VolumesCloneTest-1260869160 None] Created reservations ['619928e9-4d7c-4469-8427-3d8b9e879915', 'b505ef63-ff0d-4fec-a1bd-270439e1ad7e', 'da81668c-abe6-4ca8-b496-d85b2323ed0d', '002680b1-081e-4c4b-adb6-41159497788d'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:08:17 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-e575ef78-a16e-4cfb-96bb-90002ff21970 req-5c2a332e-658a-480a-a56f-8e5b20102ff8 tempest-TestStampPattern-831248066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6" returned: 0 in 0.415s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-e575ef78-a16e-4cfb-96bb-90002ff21970 req-5c2a332e-658a-480a-a56f-8e5b20102ff8 tempest-TestStampPattern-831248066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.440s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-e575ef78-a16e-4cfb-96bb-90002ff21970 req-5c2a332e-658a-480a-a56f-8e5b20102ff8 tempest-TestStampPattern-831248066 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1', 'name': 'volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d6d1764-8e96-43e8-ab4e-aedfbeb22b1b', 'enforce_multipath': True} {{(pid=86977) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-61c81d1e-fafc-4b97-801f-6fd1f327871e tempest-VolumesCloneTest-1260869160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-61c81d1e-fafc-4b97-801f-6fd1f327871e tempest-VolumesCloneTest-1260869160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-61c81d1e-fafc-4b97-801f-6fd1f327871e tempest-VolumesCloneTest-1260869160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-61c81d1e-fafc-4b97-801f-6fd1f327871e tempest-VolumesCloneTest-1260869160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-61c81d1e-fafc-4b97-801f-6fd1f327871e tempest-VolumesCloneTest-1260869160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-61c81d1e-fafc-4b97-801f-6fd1f327871e tempest-VolumesCloneTest-1260869160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:17 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:08:17 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:17 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-e575ef78-a16e-4cfb-96bb-90002ff21970 req-5c2a332e-658a-480a-a56f-8e5b20102ff8 tempest-TestStampPattern-831248066 None] attachment_update completed successfully. Jul 14 13:08:18 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-61c81d1e-fafc-4b97-801f-6fd1f327871e tempest-VolumesCloneTest-1260869160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.284s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:18 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-61c81d1e-fafc-4b97-801f-6fd1f327871e tempest-VolumesCloneTest-1260869160 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:08:18 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-61c81d1e-fafc-4b97-801f-6fd1f327871e tempest-VolumesCloneTest-1260869160 None] Deleted volume successfully. Jul 14 13:08:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-61c81d1e-fafc-4b97-801f-6fd1f327871e tempest-VolumesCloneTest-1260869160 None] Lock "cinder-57854770-7e20-47d8-9e06-9f3cad18ce9f-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9f8b2694-ce86-4657-b32c-b98d0e66c8be tempest-VolumesSnapshotListTestJSON-1417045210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9f8b2694-ce86-4657-b32c-b98d0e66c8be tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-9f8b2694-ce86-4657-b32c-b98d0e66c8be tempest-VolumesSnapshotListTestJSON-1417045210 None] Creating offline snapshot a30e836a-7505-4658-b841-0c4181b7d6bf of volume 4ece0ca6-351d-46ae-826f-ed13d308ac0e {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:08:18 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[367309dd-9f32-446c-947f-cf6699b33690]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9f8b2694-ce86-4657-b32c-b98d0e66c8be tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:18 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e Jul 14 13:08:18 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:19 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9f8b2694-ce86-4657-b32c-b98d0e66c8be tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e" returned: 0 in 0.404s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9f8b2694-ce86-4657-b32c-b98d0e66c8be tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:19 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf 1G Jul 14 13:08:19 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:19 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9f8b2694-ce86-4657-b32c-b98d0e66c8be tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf 1G" returned: 0 in 0.435s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9f8b2694-ce86-4657-b32c-b98d0e66c8be tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:19 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf Jul 14 13:08:19 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:19 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9f8b2694-ce86-4657-b32c-b98d0e66c8be tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf" returned: 0 in 0.308s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:19 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-9f8b2694-ce86-4657-b32c-b98d0e66c8be tempest-VolumesSnapshotListTestJSON-1417045210 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf is being set with open permissions: ugo+rw Jul 14 13:08:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9f8b2694-ce86-4657-b32c-b98d0e66c8be tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:19 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf Jul 14 13:08:19 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:20 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9f8b2694-ce86-4657-b32c-b98d0e66c8be tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf" returned: 0 in 0.255s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9f8b2694-ce86-4657-b32c-b98d0e66c8be tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:20 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.info Jul 14 13:08:20 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:20 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9f8b2694-ce86-4657-b32c-b98d0e66c8be tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.info" returned: 0 in 0.276s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:20 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-9f8b2694-ce86-4657-b32c-b98d0e66c8be tempest-VolumesSnapshotListTestJSON-1417045210 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.info is being set with open permissions: ugo+rw Jul 14 13:08:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9f8b2694-ce86-4657-b32c-b98d0e66c8be tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:20 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.info Jul 14 13:08:20 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:20 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9f8b2694-ce86-4657-b32c-b98d0e66c8be tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.info" returned: 0 in 0.292s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9f8b2694-ce86-4657-b32c-b98d0e66c8be tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.098s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:20 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-9f8b2694-ce86-4657-b32c-b98d0e66c8be tempest-VolumesSnapshotListTestJSON-1417045210 None] Create snapshot completed successfully Jul 14 13:08:21 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:08:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Flow 'volume_create_manager' (fa644f34-27b5-41dd-84f7-c5570907cc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:08:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d3adf9-e126-4f2b-a8ef-a91f9d40b854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d3adf9-e126-4f2b-a8ef-a91f9d40b854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2077939829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a33694e-4996-4fb1-a483-430ae38edbb0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8b3f018baa1542c1a33852bdb89358bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:08:21Z,use_quota=True,user_id='804012a21d3442b98f7f30dd1772df60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68074a5e-d27c-4b03-8a69-a0c6e175575e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68074a5e-d27c-4b03-8a69-a0c6e175575e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce496398-b39f-4be0-8e2f-4a0df5b7d8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce496398-b39f-4be0-8e2f-4a0df5b7d8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a33694e-4996-4fb1-a483-430ae38edbb0', 'volume_name': 'volume-0a33694e-4996-4fb1-a483-430ae38edbb0', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126eae52-2f8d-4387-af69-2b121077fcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126eae52-2f8d-4387-af69-2b121077fcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c1dd2a-6a9f-4e47-975e-fb712d35413c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:21 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Volume 0a33694e-4996-4fb1-a483-430ae38edbb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a33694e-4996-4fb1-a483-430ae38edbb0', 'volume_size': 1} Jul 14 13:08:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2077939829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a33694e-4996-4fb1-a483-430ae38edbb0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8b3f018baa1542c1a33852bdb89358bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:08:21Z,use_quota=True,user_id='804012a21d3442b98f7f30dd1772df60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:08:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Creating volume 0a33694e-4996-4fb1-a483-430ae38edbb0 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:08:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:08:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:08:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:08:21 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:08:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a33694e-4996-4fb1-a483-430ae38edbb0 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:21 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a33694e-4996-4fb1-a483-430ae38edbb0 1073741824 Jul 14 13:08:21 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:22 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a33694e-4996-4fb1-a483-430ae38edbb0 1073741824" returned: 0 in 0.513s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6269dbd8-8220-4fc2-8c3e-9219d9de25dc tempest-VolumesSnapshotListTestJSON-1417045210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a33694e-4996-4fb1-a483-430ae38edbb0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:22 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a33694e-4996-4fb1-a483-430ae38edbb0 Jul 14 13:08:22 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:22 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a33694e-4996-4fb1-a483-430ae38edbb0" returned: 0 in 0.252s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:08:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6269dbd8-8220-4fc2-8c3e-9219d9de25dc tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.266s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c1dd2a-6a9f-4e47-975e-fb712d35413c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a33694e-4996-4fb1-a483-430ae38edbb0', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d3a640-1a04-4934-a6f6-a9aa5fb7a892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-6269dbd8-8220-4fc2-8c3e-9219d9de25dc tempest-VolumesSnapshotListTestJSON-1417045210 None] Creating offline snapshot ba21aca9-ef46-4c08-92d4-0cab2bce2d48 of volume 4ece0ca6-351d-46ae-826f-ed13d308ac0e {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:08:22 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Volume volume-0a33694e-4996-4fb1-a483-430ae38edbb0 (0a33694e-4996-4fb1-a483-430ae38edbb0): created successfully Jul 14 13:08:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d3a640-1a04-4934-a6f6-a9aa5fb7a892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Flow 'volume_create_manager' (fa644f34-27b5-41dd-84f7-c5570907cc4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:08:22 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fc39e8-0e39-43f7-a1c5-fb70a78d0ed2]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6269dbd8-8220-4fc2-8c3e-9219d9de25dc tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:22 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-90612d03-8dbf-4aa2-9894-d6b660ce44f4 tempest-VolumesListTestJSON-411178042 None] Created volume successfully. Jul 14 13:08:22 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf Jul 14 13:08:22 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:22 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6269dbd8-8220-4fc2-8c3e-9219d9de25dc tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf" returned: 0 in 0.407s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-6269dbd8-8220-4fc2-8c3e-9219d9de25dc tempest-VolumesSnapshotListTestJSON-1417045210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:08:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6269dbd8-8220-4fc2-8c3e-9219d9de25dc tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:22 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48 1G Jul 14 13:08:22 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:23 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6269dbd8-8220-4fc2-8c3e-9219d9de25dc tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48 1G" returned: 0 in 0.447s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6269dbd8-8220-4fc2-8c3e-9219d9de25dc tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:23 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48 Jul 14 13:08:23 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:23 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-eaeb6015-1437-432b-b3b0-c228e7b9c55c req-03bb67f4-c870-4bf7-a463-71981ade4d40 tempest-TestStampPattern-831248066 None] Terminate volume connection completed successfully. Jul 14 13:08:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-eaeb6015-1437-432b-b3b0-c228e7b9c55c req-03bb67f4-c870-4bf7-a463-71981ade4d40 tempest-TestStampPattern-831248066 None] Deleting attachment 2d6d1764-8e96-43e8-ab4e-aedfbeb22b1b. {{(pid=86977) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 13:08:23 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6269dbd8-8220-4fc2-8c3e-9219d9de25dc tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48" returned: 0 in 0.345s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:23 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-6269dbd8-8220-4fc2-8c3e-9219d9de25dc tempest-VolumesSnapshotListTestJSON-1417045210 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48 is being set with open permissions: ugo+rw Jul 14 13:08:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6269dbd8-8220-4fc2-8c3e-9219d9de25dc tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:23 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48 Jul 14 13:08:23 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:23 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6269dbd8-8220-4fc2-8c3e-9219d9de25dc tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48" returned: 0 in 0.267s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6269dbd8-8220-4fc2-8c3e-9219d9de25dc tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.612s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:23 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-6269dbd8-8220-4fc2-8c3e-9219d9de25dc tempest-VolumesSnapshotListTestJSON-1417045210 None] Create snapshot completed successfully Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Flow 'volume_create_manager' (490203fb-1eaa-49c3-96e6-772265e41474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98ea7ad-8f2b-4eab-8471-35024c19f266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98ea7ad-8f2b-4eab-8471-35024c19f266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1740996502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31f2908-9bf9-4211-817b-cfb32ffb44f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8b3f018baa1542c1a33852bdb89358bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:08:24Z,use_quota=True,user_id='804012a21d3442b98f7f30dd1772df60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456af686-74d3-492c-89a4-def266186ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456af686-74d3-492c-89a4-def266186ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a090a0c-cda1-4847-9985-2e5def0d800b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a090a0c-cda1-4847-9985-2e5def0d800b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a31f2908-9bf9-4211-817b-cfb32ffb44f3', 'volume_name': 'volume-a31f2908-9bf9-4211-817b-cfb32ffb44f3', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b2ff9c-cfb7-4f3a-9dab-0d5125a614f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b2ff9c-cfb7-4f3a-9dab-0d5125a614f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af9bba38-4eaf-41fa-b912-5c7ed46035c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:24 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Volume a31f2908-9bf9-4211-817b-cfb32ffb44f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a31f2908-9bf9-4211-817b-cfb32ffb44f3', 'volume_size': 1} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1740996502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31f2908-9bf9-4211-817b-cfb32ffb44f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8b3f018baa1542c1a33852bdb89358bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:08:24Z,use_quota=True,user_id='804012a21d3442b98f7f30dd1772df60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Creating volume a31f2908-9bf9-4211-817b-cfb32ffb44f3 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:08:24 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a31f2908-9bf9-4211-817b-cfb32ffb44f3 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:24 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a31f2908-9bf9-4211-817b-cfb32ffb44f3 1073741824 Jul 14 13:08:24 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6d2e22ae-2d8a-415c-9d0c-aac89dd7b0f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6071602d-a931-47d9-a806-caa26fcf3db6 tempest-TestStampPattern-831248066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:24 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a31f2908-9bf9-4211-817b-cfb32ffb44f3 1073741824" returned: 0 in 0.462s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a31f2908-9bf9-4211-817b-cfb32ffb44f3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:24 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a31f2908-9bf9-4211-817b-cfb32ffb44f3 Jul 14 13:08:24 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:24 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a31f2908-9bf9-4211-817b-cfb32ffb44f3" returned: 0 in 0.234s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6d2e22ae-2d8a-415c-9d0c-aac89dd7b0f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.389s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af9bba38-4eaf-41fa-b912-5c7ed46035c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a31f2908-9bf9-4211-817b-cfb32ffb44f3', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5069d6c3-fb66-4f09-8f0f-756a055db5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-6d2e22ae-2d8a-415c-9d0c-aac89dd7b0f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Creating offline snapshot a0704c77-c4c4-4887-9f00-b78461dd3842 of volume 4ece0ca6-351d-46ae-826f-ed13d308ac0e {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:08:24 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Volume volume-a31f2908-9bf9-4211-817b-cfb32ffb44f3 (a31f2908-9bf9-4211-817b-cfb32ffb44f3): created successfully Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5069d6c3-fb66-4f09-8f0f-756a055db5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Flow 'volume_create_manager' (490203fb-1eaa-49c3-96e6-772265e41474) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8abb50f-83f9-4ba5-80cc-cd0efc367dcb]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d2e22ae-2d8a-415c-9d0c-aac89dd7b0f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:24 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e396494d-4001-49e5-94e0-501f879ff599 tempest-VolumesListTestJSON-411178042 None] Created volume successfully. Jul 14 13:08:25 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48 Jul 14 13:08:25 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:25 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d2e22ae-2d8a-415c-9d0c-aac89dd7b0f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48" returned: 0 in 0.362s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-6d2e22ae-2d8a-415c-9d0c-aac89dd7b0f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:08:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d2e22ae-2d8a-415c-9d0c-aac89dd7b0f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a0704c77-c4c4-4887-9f00-b78461dd3842 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:25 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a0704c77-c4c4-4887-9f00-b78461dd3842 1G Jul 14 13:08:25 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:25 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:08:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Flow 'volume_create_manager' (cb0532aa-affe-45aa-94c4-48795a18fbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:08:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf94172-8a2f-4570-8203-f5a75abe201e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf94172-8a2f-4570-8203-f5a75abe201e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-25407742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01834c53-c3be-4415-a453-ba03790590ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8b3f018baa1542c1a33852bdb89358bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:08:26Z,use_quota=True,user_id='804012a21d3442b98f7f30dd1772df60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c398b2f9-2ad2-43d1-9148-f7bae8ad772b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c398b2f9-2ad2-43d1-9148-f7bae8ad772b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (237076db-c277-4e15-b2ee-147d421907bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (237076db-c277-4e15-b2ee-147d421907bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01834c53-c3be-4415-a453-ba03790590ab', 'volume_name': 'volume-01834c53-c3be-4415-a453-ba03790590ab', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f2464f-8a71-4fca-b64b-5ae4dcb3b97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f2464f-8a71-4fca-b64b-5ae4dcb3b97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363a8359-15b4-4c5c-b081-963b0dfb5736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:25 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Volume 01834c53-c3be-4415-a453-ba03790590ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01834c53-c3be-4415-a453-ba03790590ab', 'volume_size': 1} Jul 14 13:08:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:25 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d2e22ae-2d8a-415c-9d0c-aac89dd7b0f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a0704c77-c4c4-4887-9f00-b78461dd3842 1G" returned: 0 in 0.464s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d2e22ae-2d8a-415c-9d0c-aac89dd7b0f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a0704c77-c4c4-4887-9f00-b78461dd3842 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:25 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a0704c77-c4c4-4887-9f00-b78461dd3842 Jul 14 13:08:25 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:26 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d2e22ae-2d8a-415c-9d0c-aac89dd7b0f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a0704c77-c4c4-4887-9f00-b78461dd3842" returned: 0 in 0.284s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:26 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-6d2e22ae-2d8a-415c-9d0c-aac89dd7b0f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a0704c77-c4c4-4887-9f00-b78461dd3842 is being set with open permissions: ugo+rw Jul 14 13:08:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d2e22ae-2d8a-415c-9d0c-aac89dd7b0f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a0704c77-c4c4-4887-9f00-b78461dd3842 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:26 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a0704c77-c4c4-4887-9f00-b78461dd3842 Jul 14 13:08:26 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:26 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d2e22ae-2d8a-415c-9d0c-aac89dd7b0f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a0704c77-c4c4-4887-9f00-b78461dd3842" returned: 0 in 0.238s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:26 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=76,cinder:UPDATE=95,cinder:DELETE=9,cinder:INSERT=15 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:08:26 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=77,cinder:UPDATE=77,cinder:INSERT=24,cinder:DELETE=8 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:08:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6d2e22ae-2d8a-415c-9d0c-aac89dd7b0f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.463s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6071602d-a931-47d9-a806-caa26fcf3db6 tempest-TestStampPattern-831248066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.851s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:26 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-6071602d-a931-47d9-a806-caa26fcf3db6 tempest-TestStampPattern-831248066 None] Creating offline snapshot 0f3c0693-9082-427d-a43d-39d5c0e0baa4 of volume 3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:08:26 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-6d2e22ae-2d8a-415c-9d0c-aac89dd7b0f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Create snapshot completed successfully Jul 14 13:08:26 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[852b0aed-f734-4ff8-8750-5e7cef1eb083]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6071602d-a931-47d9-a806-caa26fcf3db6 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:26 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 Jul 14 13:08:26 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:26 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6071602d-a931-47d9-a806-caa26fcf3db6 tempest-TestStampPattern-831248066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6" returned: 0 in 0.380s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6071602d-a931-47d9-a806-caa26fcf3db6 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:26 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4 1G Jul 14 13:08:26 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:27 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6071602d-a931-47d9-a806-caa26fcf3db6 tempest-TestStampPattern-831248066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4 1G" returned: 0 in 0.410s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6071602d-a931-47d9-a806-caa26fcf3db6 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:27 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4 Jul 14 13:08:27 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] Acquiring lock "cinder-a0704c77-c4c4-4887-9f00-b78461dd3842-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "cinder-a0704c77-c4c4-4887-9f00-b78461dd3842-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] Acquiring lock "cinder-quobyte-4ece0ca6-351d-46ae-826f-ed13d308ac0e" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "cinder-quobyte-4ece0ca6-351d-46ae-826f-ed13d308ac0e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] Acquiring lock "cinder-quobyte-a0704c77-c4c4-4887-9f00-b78461dd3842" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "cinder-quobyte-a0704c77-c4c4-4887-9f00-b78461dd3842" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] Deleting offline snapshot a0704c77-c4c4-4887-9f00-b78461dd3842 of volume 4ece0ca6-351d-46ae-826f-ed13d308ac0e {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:08:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] snapshot_file for this snap is: volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a0704c77-c4c4-4887-9f00-b78461dd3842 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:08:27 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[8805322f-cf10-44bc-98c8-5d094dc6fb30]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a0704c77-c4c4-4887-9f00-b78461dd3842 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:27 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6071602d-a931-47d9-a806-caa26fcf3db6 tempest-TestStampPattern-831248066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4" returned: 0 in 0.306s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:27 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-6071602d-a931-47d9-a806-caa26fcf3db6 tempest-TestStampPattern-831248066 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4 is being set with open permissions: ugo+rw Jul 14 13:08:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6071602d-a931-47d9-a806-caa26fcf3db6 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:27 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a0704c77-c4c4-4887-9f00-b78461dd3842 Jul 14 13:08:27 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:27 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4 Jul 14 13:08:27 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:27 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6071602d-a931-47d9-a806-caa26fcf3db6 tempest-TestStampPattern-831248066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4" returned: 0 in 0.258s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:27 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a0704c77-c4c4-4887-9f00-b78461dd3842" returned: 0 in 0.362s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:08:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6071602d-a931-47d9-a806-caa26fcf3db6 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:27 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[26238f30-6a6b-4f8f-a5be-4626fa885137]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:27 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.info Jul 14 13:08:27 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:27 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48 Jul 14 13:08:27 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:28 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6071602d-a931-47d9-a806-caa26fcf3db6 tempest-TestStampPattern-831248066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.info" returned: 0 in 0.247s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:28 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-6071602d-a931-47d9-a806-caa26fcf3db6 tempest-TestStampPattern-831248066 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.info is being set with open permissions: ugo+rw Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6071602d-a931-47d9-a806-caa26fcf3db6 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:28 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.info Jul 14 13:08:28 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:28 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48" returned: 0 in 0.375s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a0704c77-c4c4-4887-9f00-b78461dd3842 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:28 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a0704c77-c4c4-4887-9f00-b78461dd3842 Jul 14 13:08:28 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:28 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6071602d-a931-47d9-a806-caa26fcf3db6 tempest-TestStampPattern-831248066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.info" returned: 0 in 0.259s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6071602d-a931-47d9-a806-caa26fcf3db6 tempest-TestStampPattern-831248066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.672s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-25407742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01834c53-c3be-4415-a453-ba03790590ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8b3f018baa1542c1a33852bdb89358bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:08:26Z,use_quota=True,user_id='804012a21d3442b98f7f30dd1772df60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Creating volume 01834c53-c3be-4415-a453-ba03790590ab {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:08:28 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-01834c53-c3be-4415-a453-ba03790590ab 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:28 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-01834c53-c3be-4415-a453-ba03790590ab 1073741824 Jul 14 13:08:28 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:28 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-6071602d-a931-47d9-a806-caa26fcf3db6 tempest-TestStampPattern-831248066 None] Create snapshot completed successfully Jul 14 13:08:28 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a0704c77-c4c4-4887-9f00-b78461dd3842" returned: 0 in 0.436s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a0704c77-c4c4-4887-9f00-b78461dd3842 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:28 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a0704c77-c4c4-4887-9f00-b78461dd3842 Jul 14 13:08:28 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:28 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-01834c53-c3be-4415-a453-ba03790590ab 1073741824" returned: 0 in 0.507s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-01834c53-c3be-4415-a453-ba03790590ab {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:28 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a0704c77-c4c4-4887-9f00-b78461dd3842" returned: 0 in 0.276s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:28 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-01834c53-c3be-4415-a453-ba03790590ab Jul 14 13:08:28 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "cinder-quobyte-a0704c77-c4c4-4887-9f00-b78461dd3842" released by "_delete_snapshot" :: held 1.579s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "cinder-quobyte-4ece0ca6-351d-46ae-826f-ed13d308ac0e" released by "delete_snapshot" :: held 1.607s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:28 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] Created reservations ['907a4fc9-54db-4277-ad46-406187f647db', 'e0f6b962-70f0-4fc6-9d37-7cd4bc2606b1', '3fd643ba-3c08-4387-b7ff-5d5362aa0ae6', '1c3f9910-50fc-4dee-bf2f-fbb0968b0508'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:08:29 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] Delete snapshot completed successfully. Jul 14 13:08:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b1b3cbdb-10e9-4d6e-8ad2-7f0c05de0076 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "cinder-a0704c77-c4c4-4887-9f00-b78461dd3842-delete_snapshot" released by "delete_snapshot" :: held 1.752s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:29 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-01834c53-c3be-4415-a453-ba03790590ab" returned: 0 in 0.275s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:08:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363a8359-15b4-4c5c-b081-963b0dfb5736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01834c53-c3be-4415-a453-ba03790590ab', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b05ef6-f13c-4d0a-a95c-c857c2df2752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:29 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Volume volume-01834c53-c3be-4415-a453-ba03790590ab (01834c53-c3be-4415-a453-ba03790590ab): created successfully Jul 14 13:08:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b05ef6-f13c-4d0a-a95c-c857c2df2752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Flow 'volume_create_manager' (cb0532aa-affe-45aa-94c4-48795a18fbc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:08:29 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-6dafa875-a6b6-4ef0-8ed2-2bccffe1da5f tempest-VolumesListTestJSON-411178042 None] Created volume successfully. Jul 14 13:08:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] Acquiring lock "cinder-ba21aca9-ef46-4c08-92d4-0cab2bce2d48-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "cinder-ba21aca9-ef46-4c08-92d4-0cab2bce2d48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] Acquiring lock "cinder-quobyte-4ece0ca6-351d-46ae-826f-ed13d308ac0e" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "cinder-quobyte-4ece0ca6-351d-46ae-826f-ed13d308ac0e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] Acquiring lock "cinder-quobyte-ba21aca9-ef46-4c08-92d4-0cab2bce2d48" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "cinder-quobyte-ba21aca9-ef46-4c08-92d4-0cab2bce2d48" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] Deleting offline snapshot ba21aca9-ef46-4c08-92d4-0cab2bce2d48 of volume 4ece0ca6-351d-46ae-826f-ed13d308ac0e {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:08:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] snapshot_file for this snap is: volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:08:29 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[16208cdd-fa1e-4e9b-9216-686cd77759e6]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:29 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48 Jul 14 13:08:29 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:30 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48" returned: 0 in 0.456s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:08:30 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6f985c-e25d-4f0d-a76b-5e546d5d5c9a]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:30 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf Jul 14 13:08:30 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:30 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf" returned: 0 in 0.427s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:08:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:30 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48 Jul 14 13:08:30 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:30 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48" returned: 0 in 0.444s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:31 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48 Jul 14 13:08:31 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:31 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.ba21aca9-ef46-4c08-92d4-0cab2bce2d48" returned: 0 in 0.263s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "cinder-quobyte-ba21aca9-ef46-4c08-92d4-0cab2bce2d48" released by "_delete_snapshot" :: held 1.713s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "cinder-quobyte-4ece0ca6-351d-46ae-826f-ed13d308ac0e" released by "delete_snapshot" :: held 1.736s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:31 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] Created reservations ['443f8f83-e462-4733-9832-feb4479494e1', '76925293-d3d2-43fb-b981-8dad1d982563', '85daf976-c1db-4865-88db-b7116ab8f44c', '6ef54b4d-b96a-467b-b3a7-7ed256cd8a0e'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:08:31 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] Delete snapshot completed successfully. Jul 14 13:08:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e01b0748-14a7-48da-8b76-b24c8cf3fa99 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "cinder-ba21aca9-ef46-4c08-92d4-0cab2bce2d48-delete_snapshot" released by "delete_snapshot" :: held 1.927s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1ed65c99-1d51-4f3b-8785-30498356b9f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Acquiring lock "cinder-a30e836a-7505-4658-b841-0c4181b7d6bf-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1ed65c99-1d51-4f3b-8785-30498356b9f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "cinder-a30e836a-7505-4658-b841-0c4181b7d6bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1ed65c99-1d51-4f3b-8785-30498356b9f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Acquiring lock "cinder-quobyte-4ece0ca6-351d-46ae-826f-ed13d308ac0e" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1ed65c99-1d51-4f3b-8785-30498356b9f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "cinder-quobyte-4ece0ca6-351d-46ae-826f-ed13d308ac0e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1ed65c99-1d51-4f3b-8785-30498356b9f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Acquiring lock "cinder-quobyte-a30e836a-7505-4658-b841-0c4181b7d6bf" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1ed65c99-1d51-4f3b-8785-30498356b9f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "cinder-quobyte-a30e836a-7505-4658-b841-0c4181b7d6bf" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:31 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-1ed65c99-1d51-4f3b-8785-30498356b9f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Deleting offline snapshot a30e836a-7505-4658-b841-0c4181b7d6bf of volume 4ece0ca6-351d-46ae-826f-ed13d308ac0e {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:08:31 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-1ed65c99-1d51-4f3b-8785-30498356b9f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] snapshot_file for this snap is: volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:08:31 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[af880c8a-1621-4a0c-a883-83d498a61f48]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1ed65c99-1d51-4f3b-8785-30498356b9f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:31 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf Jul 14 13:08:31 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-172bc0f8-9a84-4ddf-9c5a-95dac7615d27 tempest-VolumesListTestJSON-411178042 None] Acquiring lock "cinder-01834c53-c3be-4415-a453-ba03790590ab-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-172bc0f8-9a84-4ddf-9c5a-95dac7615d27 tempest-VolumesListTestJSON-411178042 None] Lock "cinder-01834c53-c3be-4415-a453-ba03790590ab-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-172bc0f8-9a84-4ddf-9c5a-95dac7615d27 tempest-VolumesListTestJSON-411178042 None] Acquiring lock "cinder-quobyte-01834c53-c3be-4415-a453-ba03790590ab" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-172bc0f8-9a84-4ddf-9c5a-95dac7615d27 tempest-VolumesListTestJSON-411178042 None] Lock "cinder-quobyte-01834c53-c3be-4415-a453-ba03790590ab" acquired by "delete_volume" :: waited 0.020s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:32 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f71db3e-c240-44d7-a28b-0ddd7eeca4eb]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-172bc0f8-9a84-4ddf-9c5a-95dac7615d27 tempest-VolumesListTestJSON-411178042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-01834c53-c3be-4415-a453-ba03790590ab {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:32 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1ed65c99-1d51-4f3b-8785-30498356b9f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf" returned: 0 in 0.476s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:32 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-1ed65c99-1d51-4f3b-8785-30498356b9f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:08:32 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68abc2c-58ad-4d32-b0b5-65f61ba5597d]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1ed65c99-1d51-4f3b-8785-30498356b9f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:32 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-01834c53-c3be-4415-a453-ba03790590ab Jul 14 13:08:32 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:32 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e Jul 14 13:08:32 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:32 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-172bc0f8-9a84-4ddf-9c5a-95dac7615d27 tempest-VolumesListTestJSON-411178042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-01834c53-c3be-4415-a453-ba03790590ab" returned: 0 in 0.427s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-172bc0f8-9a84-4ddf-9c5a-95dac7615d27 tempest-VolumesListTestJSON-411178042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-01834c53-c3be-4415-a453-ba03790590ab {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:32 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-01834c53-c3be-4415-a453-ba03790590ab Jul 14 13:08:32 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:32 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1ed65c99-1d51-4f3b-8785-30498356b9f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e" returned: 0 in 0.435s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1ed65c99-1d51-4f3b-8785-30498356b9f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:32 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf Jul 14 13:08:32 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:32 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-172bc0f8-9a84-4ddf-9c5a-95dac7615d27 tempest-VolumesListTestJSON-411178042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-01834c53-c3be-4415-a453-ba03790590ab" returned: 0 in 0.275s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-172bc0f8-9a84-4ddf-9c5a-95dac7615d27 tempest-VolumesListTestJSON-411178042 None] Lock "cinder-quobyte-01834c53-c3be-4415-a453-ba03790590ab" released by "delete_volume" :: held 0.753s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:32 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-172bc0f8-9a84-4ddf-9c5a-95dac7615d27 tempest-VolumesListTestJSON-411178042 None] Created reservations ['1b66b5a2-fbab-4a42-96e5-77e65a694ba7', '8c6ffe79-ecae-4564-a5f1-297582f9b998', '321b5e1c-e174-4ce2-b696-eb5c0f851a62', 'b7165de8-2811-46d2-a2e3-99920b235a2b'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-172bc0f8-9a84-4ddf-9c5a-95dac7615d27 tempest-VolumesListTestJSON-411178042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-172bc0f8-9a84-4ddf-9c5a-95dac7615d27 tempest-VolumesListTestJSON-411178042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-172bc0f8-9a84-4ddf-9c5a-95dac7615d27 tempest-VolumesListTestJSON-411178042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-172bc0f8-9a84-4ddf-9c5a-95dac7615d27 tempest-VolumesListTestJSON-411178042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-172bc0f8-9a84-4ddf-9c5a-95dac7615d27 tempest-VolumesListTestJSON-411178042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-172bc0f8-9a84-4ddf-9c5a-95dac7615d27 tempest-VolumesListTestJSON-411178042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:33 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:08:33 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:33 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1ed65c99-1d51-4f3b-8785-30498356b9f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf" returned: 0 in 0.429s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1ed65c99-1d51-4f3b-8785-30498356b9f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:33 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf Jul 14 13:08:33 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:33 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-172bc0f8-9a84-4ddf-9c5a-95dac7615d27 tempest-VolumesListTestJSON-411178042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.321s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-172bc0f8-9a84-4ddf-9c5a-95dac7615d27 tempest-VolumesListTestJSON-411178042 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:08:33 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-172bc0f8-9a84-4ddf-9c5a-95dac7615d27 tempest-VolumesListTestJSON-411178042 None] Deleted volume successfully. Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d4948753-ef91-492e-8f27-c13514f63834 tempest-VolumesListTestJSON-411178042 None] Acquiring lock "cinder-a31f2908-9bf9-4211-817b-cfb32ffb44f3-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-172bc0f8-9a84-4ddf-9c5a-95dac7615d27 tempest-VolumesListTestJSON-411178042 None] Lock "cinder-01834c53-c3be-4415-a453-ba03790590ab-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d4948753-ef91-492e-8f27-c13514f63834 tempest-VolumesListTestJSON-411178042 None] Lock "cinder-a31f2908-9bf9-4211-817b-cfb32ffb44f3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d4948753-ef91-492e-8f27-c13514f63834 tempest-VolumesListTestJSON-411178042 None] Acquiring lock "cinder-quobyte-a31f2908-9bf9-4211-817b-cfb32ffb44f3" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:33 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1ed65c99-1d51-4f3b-8785-30498356b9f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e.a30e836a-7505-4658-b841-0c4181b7d6bf" returned: 0 in 0.322s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d4948753-ef91-492e-8f27-c13514f63834 tempest-VolumesListTestJSON-411178042 None] Lock "cinder-quobyte-a31f2908-9bf9-4211-817b-cfb32ffb44f3" acquired by "delete_volume" :: waited 0.041s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1ed65c99-1d51-4f3b-8785-30498356b9f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "cinder-quobyte-a30e836a-7505-4658-b841-0c4181b7d6bf" released by "_delete_snapshot" :: held 1.809s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1ed65c99-1d51-4f3b-8785-30498356b9f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "cinder-quobyte-4ece0ca6-351d-46ae-826f-ed13d308ac0e" released by "delete_snapshot" :: held 1.838s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf0ce72-c52e-499f-afcc-35a2979b0850]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d4948753-ef91-492e-8f27-c13514f63834 tempest-VolumesListTestJSON-411178042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a31f2908-9bf9-4211-817b-cfb32ffb44f3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-1ed65c99-1d51-4f3b-8785-30498356b9f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Created reservations ['e050113e-8e62-4600-a524-fab4480287b0', '74d305eb-2d6a-4522-830d-5c35e76313d4', '10619fec-3df7-477f-9f1b-8f1aea2e33f2', '1e65540d-6c35-42dd-b5a2-b9375c3bdfdb'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:08:33 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a31f2908-9bf9-4211-817b-cfb32ffb44f3 Jul 14 13:08:33 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:33 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-1ed65c99-1d51-4f3b-8785-30498356b9f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Delete snapshot completed successfully. Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1ed65c99-1d51-4f3b-8785-30498356b9f9 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "cinder-a30e836a-7505-4658-b841-0c4181b7d6bf-delete_snapshot" released by "delete_snapshot" :: held 2.030s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-9eb5c225-50ac-49de-966d-41c4beffff44 tempest-VolumesSnapshotListTestJSON-1417045210 None] Acquiring lock "cinder-4ece0ca6-351d-46ae-826f-ed13d308ac0e-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-9eb5c225-50ac-49de-966d-41c4beffff44 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "cinder-4ece0ca6-351d-46ae-826f-ed13d308ac0e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:34 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d4948753-ef91-492e-8f27-c13514f63834 tempest-VolumesListTestJSON-411178042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a31f2908-9bf9-4211-817b-cfb32ffb44f3" returned: 0 in 0.473s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d4948753-ef91-492e-8f27-c13514f63834 tempest-VolumesListTestJSON-411178042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a31f2908-9bf9-4211-817b-cfb32ffb44f3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-9eb5c225-50ac-49de-966d-41c4beffff44 tempest-VolumesSnapshotListTestJSON-1417045210 None] Acquiring lock "cinder-quobyte-4ece0ca6-351d-46ae-826f-ed13d308ac0e" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-9eb5c225-50ac-49de-966d-41c4beffff44 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "cinder-quobyte-4ece0ca6-351d-46ae-826f-ed13d308ac0e" acquired by "delete_volume" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:34 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a31f2908-9bf9-4211-817b-cfb32ffb44f3 Jul 14 13:08:34 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[af437307-ef6d-4cba-b87c-d49bd84e9723]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9eb5c225-50ac-49de-966d-41c4beffff44 tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:34 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e Jul 14 13:08:34 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:34 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d4948753-ef91-492e-8f27-c13514f63834 tempest-VolumesListTestJSON-411178042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a31f2908-9bf9-4211-817b-cfb32ffb44f3" returned: 0 in 0.282s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d4948753-ef91-492e-8f27-c13514f63834 tempest-VolumesListTestJSON-411178042 None] Lock "cinder-quobyte-a31f2908-9bf9-4211-817b-cfb32ffb44f3" released by "delete_volume" :: held 0.811s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-d4948753-ef91-492e-8f27-c13514f63834 tempest-VolumesListTestJSON-411178042 None] Created reservations ['aba15e3b-937f-467e-86b4-a5e8fa1b7ded', '660d4f6f-ca0f-49e3-8cf3-34a4aa866bf8', 'e01c7d28-47ef-482d-84d0-e4aca6962520', '09796241-7f1e-474e-8e54-fcdb257ef1a9'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d4948753-ef91-492e-8f27-c13514f63834 tempest-VolumesListTestJSON-411178042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d4948753-ef91-492e-8f27-c13514f63834 tempest-VolumesListTestJSON-411178042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d4948753-ef91-492e-8f27-c13514f63834 tempest-VolumesListTestJSON-411178042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d4948753-ef91-492e-8f27-c13514f63834 tempest-VolumesListTestJSON-411178042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d4948753-ef91-492e-8f27-c13514f63834 tempest-VolumesListTestJSON-411178042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d4948753-ef91-492e-8f27-c13514f63834 tempest-VolumesListTestJSON-411178042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:34 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:08:34 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:34 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9eb5c225-50ac-49de-966d-41c4beffff44 tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e" returned: 0 in 0.477s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9eb5c225-50ac-49de-966d-41c4beffff44 tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:34 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e Jul 14 13:08:34 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-8f45ded4-87fa-4cfd-a566-20a765d06c07 tempest-VolumesListTestJSON-411178042 None] Acquiring lock "cinder-0a33694e-4996-4fb1-a483-430ae38edbb0-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-8f45ded4-87fa-4cfd-a566-20a765d06c07 tempest-VolumesListTestJSON-411178042 None] Lock "cinder-0a33694e-4996-4fb1-a483-430ae38edbb0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-8f45ded4-87fa-4cfd-a566-20a765d06c07 tempest-VolumesListTestJSON-411178042 None] Acquiring lock "cinder-quobyte-0a33694e-4996-4fb1-a483-430ae38edbb0" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-8f45ded4-87fa-4cfd-a566-20a765d06c07 tempest-VolumesListTestJSON-411178042 None] Lock "cinder-quobyte-0a33694e-4996-4fb1-a483-430ae38edbb0" acquired by "delete_volume" :: waited 0.015s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[94856c46-464d-4320-825f-3612d4f4e21a]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8f45ded4-87fa-4cfd-a566-20a765d06c07 tempest-VolumesListTestJSON-411178042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a33694e-4996-4fb1-a483-430ae38edbb0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:34 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d4948753-ef91-492e-8f27-c13514f63834 tempest-VolumesListTestJSON-411178042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.360s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-d4948753-ef91-492e-8f27-c13514f63834 tempest-VolumesListTestJSON-411178042 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:08:34 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-d4948753-ef91-492e-8f27-c13514f63834 tempest-VolumesListTestJSON-411178042 None] Deleted volume successfully. Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d4948753-ef91-492e-8f27-c13514f63834 tempest-VolumesListTestJSON-411178042 None] Lock "cinder-a31f2908-9bf9-4211-817b-cfb32ffb44f3-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:34 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a33694e-4996-4fb1-a483-430ae38edbb0 Jul 14 13:08:34 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:34 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9eb5c225-50ac-49de-966d-41c4beffff44 tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-4ece0ca6-351d-46ae-826f-ed13d308ac0e" returned: 0 in 0.336s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:34 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-9eb5c225-50ac-49de-966d-41c4beffff44 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "cinder-quobyte-4ece0ca6-351d-46ae-826f-ed13d308ac0e" released by "delete_volume" :: held 0.900s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-9eb5c225-50ac-49de-966d-41c4beffff44 tempest-VolumesSnapshotListTestJSON-1417045210 None] Created reservations ['133f62c1-eb1a-475b-9812-46ebf4a332ba', '66caf646-f883-40f1-85bb-61ef0b1b98a6', '77c3ec29-9ef5-4163-9c6c-51107babd7a5', 'b94557ac-fe98-4bfa-bcaf-258d7dcee8a2'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9eb5c225-50ac-49de-966d-41c4beffff44 tempest-VolumesSnapshotListTestJSON-1417045210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9eb5c225-50ac-49de-966d-41c4beffff44 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9eb5c225-50ac-49de-966d-41c4beffff44 tempest-VolumesSnapshotListTestJSON-1417045210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9eb5c225-50ac-49de-966d-41c4beffff44 tempest-VolumesSnapshotListTestJSON-1417045210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9eb5c225-50ac-49de-966d-41c4beffff44 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9eb5c225-50ac-49de-966d-41c4beffff44 tempest-VolumesSnapshotListTestJSON-1417045210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:35 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:08:35 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:35 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8f45ded4-87fa-4cfd-a566-20a765d06c07 tempest-VolumesListTestJSON-411178042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a33694e-4996-4fb1-a483-430ae38edbb0" returned: 0 in 0.457s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8f45ded4-87fa-4cfd-a566-20a765d06c07 tempest-VolumesListTestJSON-411178042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a33694e-4996-4fb1-a483-430ae38edbb0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:35 devstack sudo[101186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a33694e-4996-4fb1-a483-430ae38edbb0 Jul 14 13:08:35 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:35 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9eb5c225-50ac-49de-966d-41c4beffff44 tempest-VolumesSnapshotListTestJSON-1417045210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.344s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-9eb5c225-50ac-49de-966d-41c4beffff44 tempest-VolumesSnapshotListTestJSON-1417045210 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:08:35 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-9eb5c225-50ac-49de-966d-41c4beffff44 tempest-VolumesSnapshotListTestJSON-1417045210 None] Deleted volume successfully. Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-9eb5c225-50ac-49de-966d-41c4beffff44 tempest-VolumesSnapshotListTestJSON-1417045210 None] Lock "cinder-4ece0ca6-351d-46ae-826f-ed13d308ac0e-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:35 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8f45ded4-87fa-4cfd-a566-20a765d06c07 tempest-VolumesListTestJSON-411178042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a33694e-4996-4fb1-a483-430ae38edbb0" returned: 0 in 0.279s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-8f45ded4-87fa-4cfd-a566-20a765d06c07 tempest-VolumesListTestJSON-411178042 None] Lock "cinder-quobyte-0a33694e-4996-4fb1-a483-430ae38edbb0" released by "delete_volume" :: held 0.786s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-8f45ded4-87fa-4cfd-a566-20a765d06c07 tempest-VolumesListTestJSON-411178042 None] Created reservations ['1a40a684-d393-408e-aea2-040db4df4774', '0b23402c-1db1-4f8a-b8bd-e90ac0c7014c', 'ad843726-9f4b-4aae-9aa2-302288e117a5', '088188f1-9158-419c-a8a5-45de36fb9a07'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8f45ded4-87fa-4cfd-a566-20a765d06c07 tempest-VolumesListTestJSON-411178042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8f45ded4-87fa-4cfd-a566-20a765d06c07 tempest-VolumesListTestJSON-411178042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8f45ded4-87fa-4cfd-a566-20a765d06c07 tempest-VolumesListTestJSON-411178042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8f45ded4-87fa-4cfd-a566-20a765d06c07 tempest-VolumesListTestJSON-411178042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8f45ded4-87fa-4cfd-a566-20a765d06c07 tempest-VolumesListTestJSON-411178042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8f45ded4-87fa-4cfd-a566-20a765d06c07 tempest-VolumesListTestJSON-411178042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:35 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:08:35 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Flow 'volume_create_manager' (ca1df0ea-09b0-4d87-8fb9-be8e2801c9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79814838-a9d7-448e-a270-7b2bacba2322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79814838-a9d7-448e-a270-7b2bacba2322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1093021001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f94fb295-ec42-43be-9610-6e944b85c605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c1812d4a944f86aa9b7ca951b5ae79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0f3c0693-9082-427d-a43d-39d5c0e0baa4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:08:36Z,use_quota=True,user_id='ad4fd84a419d4a199be01d07e9452633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f77560-5935-4160-b58d-bfeb4c7f9db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f77560-5935-4160-b58d-bfeb4c7f9db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1607b50e-a082-4258-bbee-75f86fe7aeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1607b50e-a082-4258-bbee-75f86fe7aeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f94fb295-ec42-43be-9610-6e944b85c605', 'volume_name': 'volume-f94fb295-ec42-43be-9610-6e944b85c605', 'volume_size': 1, 'snapshot_id': '0f3c0693-9082-427d-a43d-39d5c0e0baa4'}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (244863f9-720c-4582-b538-526957043cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (244863f9-720c-4582-b538-526957043cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b70e43-4ca7-495d-ad1c-4c625055e75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:35 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Volume f94fb295-ec42-43be-9610-6e944b85c605: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f94fb295-ec42-43be-9610-6e944b85c605', 'volume_size': 1, 'snapshot_id': '0f3c0693-9082-427d-a43d-39d5c0e0baa4'} Jul 14 13:08:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Acquiring lock "cinder-quobyte-0f3c0693-9082-427d-a43d-39d5c0e0baa4-f94fb295-ec42-43be-9610-6e944b85c605" by "_create_volume_from_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Lock "cinder-quobyte-0f3c0693-9082-427d-a43d-39d5c0e0baa4-f94fb295-ec42-43be-9610-6e944b85c605" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Creating volume f94fb295-ec42-43be-9610-6e944b85c605 from snapshot 0f3c0693-9082-427d-a43d-39d5c0e0baa4 {{(pid=86977) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Acquiring lock "cinder-quobyte-f94fb295-ec42-43be-9610-6e944b85c605" by "_copy_volume_from_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:36 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Lock "cinder-quobyte-f94fb295-ec42-43be-9610-6e944b85c605" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] snapshot: 0f3c0693-9082-427d-a43d-39d5c0e0baa4, volume: f94fb295-ec42-43be-9610-6e944b85c605, {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8f45ded4-87fa-4cfd-a566-20a765d06c07 tempest-VolumesListTestJSON-411178042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.375s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8f45ded4-87fa-4cfd-a566-20a765d06c07 tempest-VolumesListTestJSON-411178042 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:08:36 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-8f45ded4-87fa-4cfd-a566-20a765d06c07 tempest-VolumesListTestJSON-411178042 None] Deleted volume successfully. Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcffa899-d865-4b14-bae0-2d82e3112f30]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-8f45ded4-87fa-4cfd-a566-20a765d06c07 tempest-VolumesListTestJSON-411178042 None] Lock "cinder-0a33694e-4996-4fb1-a483-430ae38edbb0-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:36 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4 Jul 14 13:08:36 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:36 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4" returned: 0 in 0.467s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Creating direct copy from snapshot {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61b0051-e3f5-49b3-aa9a-e7351e1e534b]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:36 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 Jul 14 13:08:36 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:37 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6" returned: 0 in 0.486s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:37 devstack cinder-volume[86977]: DEBUG cinder.utils [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Path /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f94fb295-ec42-43be-9610-6e944b85c605 not found in is_blk_device check {{(pid=86977) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 13:08:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f94fb295-ec42-43be-9610-6e944b85c605 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:37 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f94fb295-ec42-43be-9610-6e944b85c605 Jul 14 13:08:37 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:43 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f94fb295-ec42-43be-9610-6e944b85c605" returned: 0 in 6.809s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:43 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60f034d-40f3-4cc4-bfd3-b49986c758f1]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:44 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 Jul 14 13:08:44 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:44 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6" returned: 0 in 0.880s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:44 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Image conversion details: src /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6, size 1024.00 MB, duration 6.81 sec, destination /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f94fb295-ec42-43be-9610-6e944b85c605 {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:08:44 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Converted 1024.00 MB image at 150.29 MB/s Jul 14 13:08:44 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f94fb295-ec42-43be-9610-6e944b85c605 is being set with open permissions: ugo+rw Jul 14 13:08:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f94fb295-ec42-43be-9610-6e944b85c605 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:44 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f94fb295-ec42-43be-9610-6e944b85c605 Jul 14 13:08:44 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:45 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f94fb295-ec42-43be-9610-6e944b85c605" returned: 0 in 0.351s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Lock "cinder-quobyte-f94fb295-ec42-43be-9610-6e944b85c605" released by "_copy_volume_from_snapshot" :: held 9.161s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Lock "cinder-quobyte-0f3c0693-9082-427d-a43d-39d5c0e0baa4-f94fb295-ec42-43be-9610-6e944b85c605" released by "_create_volume_from_snapshot" :: held 9.214s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.238s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b70e43-4ca7-495d-ad1c-4c625055e75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f94fb295-ec42-43be-9610-6e944b85c605', 'volume_size': 1, 'snapshot_id': '0f3c0693-9082-427d-a43d-39d5c0e0baa4'}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8179a8-45ef-4ab1-a8ee-dd3e22c8e003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:45 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Volume volume-f94fb295-ec42-43be-9610-6e944b85c605 (f94fb295-ec42-43be-9610-6e944b85c605): created successfully Jul 14 13:08:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8179a8-45ef-4ab1-a8ee-dd3e22c8e003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Flow 'volume_create_manager' (ca1df0ea-09b0-4d87-8fb9-be8e2801c9ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:08:45 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-00874107-0232-4dea-97d9-d670c37250f6 tempest-TestStampPattern-831248066 None] Created volume successfully. Jul 14 13:08:48 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:08:48 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Flow 'volume_create_manager' (f1a67085-b239-4421-a83c-8747243158d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:08:48 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e987690-8be7-437e-9807-5a3b863b3dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:48 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e987690-8be7-437e-9807-5a3b863b3dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a47d7a-4de8-4871-adf2-b47f7c7decba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5dfba5ac5f845e286418c5369687396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:08:48Z,use_quota=True,user_id='fe2b114d273645d89a98581b1572cb0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7bcba9b-e259-42f8-b3a7-1859636cb01d),volume_type_id=c7bcba9b-e259-42f8-b3a7-1859636cb01d)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:48 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9ef0cc-3224-4070-98d4-329ea2bdea9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:48 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9ef0cc-3224-4070-98d4-329ea2bdea9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:48 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f833e016-908a-4ecb-86cd-0cbd4770398b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:48 devstack cinder-volume[86977]: DEBUG cinder.image.glance [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Creating Keystone auth plugin from conf {{(pid=86977) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 13:08:48 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f833e016-908a-4ecb-86cd-0cbd4770398b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e8a47d7a-4de8-4871-adf2-b47f7c7decba', 'volume_name': 'volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba', 'volume_size': 1, 'image_id': '9e4a1f47-a5f0-4b9b-a117-881203ab5c41', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e4a1f47-a5f0-4b9b-a117-881203ab5c41', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ea0ebfc9e66acc3026f7ddd7eb294a56', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e5dfba5ac5f845e286418c5369687396', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'acc4939f35a7d60a1317d04195f9eb6230f6dbc60bfa8684e51caf56daa7bb7ac95d37209ee9b0953ab42455e26bdddd384cba9f80b7903858523c07ed0e013f', 'id': '9e4a1f47-a5f0-4b9b-a117-881203ab5c41', 'created_at': datetime.datetime(2026, 7, 14, 11, 8, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 11, 8, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e4a1f47-a5f0-4b9b-a117-881203ab5c41/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:48 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff28ffa-1443-439f-9629-e5f012f28b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:48 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff28ffa-1443-439f-9629-e5f012f28b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:48 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c58af88-897c-4431-9e91-0632c207c634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:48 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Volume e8a47d7a-4de8-4871-adf2-b47f7c7decba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba', 'volume_size': 1, 'image_id': '9e4a1f47-a5f0-4b9b-a117-881203ab5c41', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e4a1f47-a5f0-4b9b-a117-881203ab5c41', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ea0ebfc9e66acc3026f7ddd7eb294a56', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e5dfba5ac5f845e286418c5369687396', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'acc4939f35a7d60a1317d04195f9eb6230f6dbc60bfa8684e51caf56daa7bb7ac95d37209ee9b0953ab42455e26bdddd384cba9f80b7903858523c07ed0e013f', 'id': '9e4a1f47-a5f0-4b9b-a117-881203ab5c41', 'created_at': datetime.datetime(2026, 7, 14, 11, 8, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 11, 8, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e4a1f47-a5f0-4b9b-a117-881203ab5c41/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 14 13:08:48 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Trying to clone e8a47d7a-4de8-4871-adf2-b47f7c7decba from image 9e4a1f47-a5f0-4b9b-a117-881203ab5c41 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9e4a1f47-a5f0-4b9b-a117-881203ab5c41', 'metadata': {}}]). {{(pid=86977) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 13:08:48 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:751}} Jul 14 13:08:48 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Image download 0.00 MB at 0.00 MB/s Jul 14 13:08:48 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[50672c37-2134-4e51-8165-f85f9726c5a2]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:49 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD Jul 14 13:08:49 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:49 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD" returned: 0 in 0.509s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:49 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD Jul 14 13:08:49 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:49 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD" returned: 1 in 0.399s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:08:49 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Temporary image 9e4a1f47-a5f0-4b9b-a117-881203ab5c41 is fetched for user fe2b114d273645d89a98581b1572cb0e. {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:1450}} Jul 14 13:08:49 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcf05fd-6240-4272-860f-8c6b68893cd4]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:50 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD Jul 14 13:08:50 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:50 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD" returned: 0 in 0.399s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:50 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD Jul 14 13:08:50 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:50 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD" returned: 1 in 0.492s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:08:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a47d7a-4de8-4871-adf2-b47f7c7decba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5dfba5ac5f845e286418c5369687396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:08:48Z,use_quota=True,user_id='fe2b114d273645d89a98581b1572cb0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7bcba9b-e259-42f8-b3a7-1859636cb01d),volume_type_id=c7bcba9b-e259-42f8-b3a7-1859636cb01d)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:08:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Creating volume e8a47d7a-4de8-4871-adf2-b47f7c7decba {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:08:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:08:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:08:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:08:50 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:08:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:50 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba 1073741824 Jul 14 13:08:50 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:51 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba 1073741824" returned: 0 in 0.697s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:51 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba Jul 14 13:08:51 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:51 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba" returned: 0 in 0.301s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:08:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:51 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Attempting download of 9e4a1f47-a5f0-4b9b-a117-881203ab5c41 ((None, [{'url': 'file:///opt/stack/data/glance/images/9e4a1f47-a5f0-4b9b-a117-881203ab5c41', 'metadata': {}}])) to volume e8a47d7a-4de8-4871-adf2-b47f7c7decba. {{(pid=86977) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 13:08:52 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[8470a41a-a3ef-458c-9a06-b7104e59f3b3]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e4a1f47-a5f0-4b9b-a117-881203ab5c41__myeafat {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:52 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e4a1f47-a5f0-4b9b-a117-881203ab5c41__myeafat Jul 14 13:08:52 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:52 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e4a1f47-a5f0-4b9b-a117-881203ab5c41__myeafat" returned: 0 in 0.457s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e4a1f47-a5f0-4b9b-a117-881203ab5c41__myeafat {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:52 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e4a1f47-a5f0-4b9b-a117-881203ab5c41__myeafat Jul 14 13:08:52 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:52 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e4a1f47-a5f0-4b9b-a117-881203ab5c41__myeafat" returned: 1 in 0.436s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e4a1f47-a5f0-4b9b-a117-881203ab5c41__myeafat' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:08:52 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[49691316-349f-4cf3-b351-8d6309873a65]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:53 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD Jul 14 13:08:53 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:53 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD" returned: 0 in 0.518s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:53 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD Jul 14 13:08:53 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:54 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD" returned: 1 in 0.570s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:08:54 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] 9e4a1f47-a5f0-4b9b-a117-881203ab5c41 was raw, converting to raw {{(pid=86977) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1139}} Jul 14 13:08:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:54 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba Jul 14 13:08:54 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:54 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba" returned: 0 in 0.631s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:54 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9e4a1f47-a5f0-4b9b-a117-881203ab5c41_splafqk3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:08:54 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Converted 0.00 MB image at 0.00 MB/s Jul 14 13:08:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:54 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba 1G Jul 14 13:08:54 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:55 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba 1G" returned: 0 in 0.417s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:55 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[f866204b-6130-4a27-88ec-ee9a95585448]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:55 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba Jul 14 13:08:55 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:55 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba" returned: 0 in 0.542s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:55 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba Jul 14 13:08:55 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:56 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba" returned: 1 in 0.546s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:08:56 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Downloaded image 9e4a1f47-a5f0-4b9b-a117-881203ab5c41 ((None, [{'url': 'file:///opt/stack/data/glance/images/9e4a1f47-a5f0-4b9b-a117-881203ab5c41', 'metadata': {}}])) to volume e8a47d7a-4de8-4871-adf2-b47f7c7decba successfully. {{(pid=86977) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 13:08:56 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Temporary image 9e4a1f47-a5f0-4b9b-a117-881203ab5c41 for user fe2b114d273645d89a98581b1572cb0e is deleted. {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:1454}} Jul 14 13:08:56 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Marking volume e8a47d7a-4de8-4871-adf2-b47f7c7decba as bootable. {{(pid=86977) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 13:08:56 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Copying metadata from image 9e4a1f47-a5f0-4b9b-a117-881203ab5c41 to e8a47d7a-4de8-4871-adf2-b47f7c7decba. {{(pid=86977) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 13:08:56 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Creating volume glance metadata for volume e8a47d7a-4de8-4871-adf2-b47f7c7decba backed by image 9e4a1f47-a5f0-4b9b-a117-881203ab5c41 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9e4a1f47-a5f0-4b9b-a117-881203ab5c41', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ea0ebfc9e66acc3026f7ddd7eb294a56', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86977) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 13:08:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c58af88-897c-4431-9e91-0632c207c634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba', 'volume_size': 1, 'image_id': '9e4a1f47-a5f0-4b9b-a117-881203ab5c41', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e4a1f47-a5f0-4b9b-a117-881203ab5c41', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ea0ebfc9e66acc3026f7ddd7eb294a56', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e5dfba5ac5f845e286418c5369687396', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'acc4939f35a7d60a1317d04195f9eb6230f6dbc60bfa8684e51caf56daa7bb7ac95d37209ee9b0953ab42455e26bdddd384cba9f80b7903858523c07ed0e013f', 'id': '9e4a1f47-a5f0-4b9b-a117-881203ab5c41', 'created_at': datetime.datetime(2026, 7, 14, 11, 8, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 11, 8, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e4a1f47-a5f0-4b9b-a117-881203ab5c41/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd982c7b-e14c-4b0b-acaf-34ad218436f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:08:56 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Volume volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba (e8a47d7a-4de8-4871-adf2-b47f7c7decba): created successfully Jul 14 13:08:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd982c7b-e14c-4b0b-acaf-34ad218436f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:08:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Flow 'volume_create_manager' (f1a67085-b239-4421-a83c-8747243158d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:08:56 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e69276b8-855b-4449-a8f5-8ac69b3ed8c6 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Created volume successfully. Jul 14 13:08:57 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Acquiring lock "cinder-e8a47d7a-4de8-4871-adf2-b47f7c7decba-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:57 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Lock "cinder-e8a47d7a-4de8-4871-adf2-b47f7c7decba-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:57 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Acquiring lock "cinder-quobyte-e8a47d7a-4de8-4871-adf2-b47f7c7decba" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:08:57 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Lock "cinder-quobyte-e8a47d7a-4de8-4871-adf2-b47f7c7decba" acquired by "delete_volume" :: waited 0.023s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:08:57 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49b4312-9685-4f8b-b061-78da165bb316]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:08:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:57 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba Jul 14 13:08:57 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:57 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba" returned: 0 in 0.435s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:58 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba Jul 14 13:08:58 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:58 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba" returned: 1 in 0.427s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:08:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:58 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba Jul 14 13:08:58 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:58 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e8a47d7a-4de8-4871-adf2-b47f7c7decba" returned: 0 in 0.392s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Lock "cinder-quobyte-e8a47d7a-4de8-4871-adf2-b47f7c7decba" released by "delete_volume" :: held 1.342s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:08:58 devstack cinder-volume[86977]: WARNING cinder.quota [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:08:58 devstack cinder-volume[86977]: WARNING cinder.quota [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:08:58 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Created reservations ['931c5f2c-cd30-4f16-88bb-fdb17cbd81df', 'c774afc2-e4aa-4381-865f-c7cbafd44c04', '80cc4c84-bb61-44f0-88d0-3ddcf9b690c0', '0c5fd271-e7f8-488c-8acd-dccd58bea919'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:08:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:08:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:08:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:08:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:08:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:08:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:08:59 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:08:59 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:08:59 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Jul 14 13:08:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.258s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:08:59 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:08:59 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Deleted volume successfully. Jul 14 13:08:59 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ff867b8f-e145-4244-b66c-c6d98b900891 tempest-VolumeAndVolumeTypeFromImageTest-1731081596 None] Lock "cinder-e8a47d7a-4de8-4871-adf2-b47f7c7decba-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Flow 'volume_create_manager' (dff9e3fe-10a5-48a5-a4fe-46b14a917f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e5bd58e-d9a1-4573-b944-cd845d7b6949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e5bd58e-d9a1-4573-b944-cd845d7b6949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-244810476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec6c0024-4d49-4431-b17e-29ea8b7b5f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac9bb41ff0d4f56834b7555b2b16403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:05Z,use_quota=True,user_id='5e8113e1c1fd45789fd594f09661f719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3477e947-4749-4480-b6de-adf4a52e87e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3477e947-4749-4480-b6de-adf4a52e87e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44576065-bbc1-4a90-a8b4-7003fdeb823b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44576065-bbc1-4a90-a8b4-7003fdeb823b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec6c0024-4d49-4431-b17e-29ea8b7b5f85', 'volume_name': 'volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae66de14-82b1-4326-941a-02121d6fc77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae66de14-82b1-4326-941a-02121d6fc77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0a137c-de95-4e66-8777-b7a4ca19fe27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:05 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Volume ec6c0024-4d49-4431-b17e-29ea8b7b5f85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85', 'volume_size': 1} Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-244810476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec6c0024-4d49-4431-b17e-29ea8b7b5f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac9bb41ff0d4f56834b7555b2b16403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:05Z,use_quota=True,user_id='5e8113e1c1fd45789fd594f09661f719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Creating volume ec6c0024-4d49-4431-b17e-29ea8b7b5f85 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:09:05 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:05 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85 1073741824 Jul 14 13:09:05 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:05 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85 1073741824" returned: 0 in 0.550s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:05 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85 Jul 14 13:09:05 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:06 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85" returned: 0 in 0.385s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:09:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0a137c-de95-4e66-8777-b7a4ca19fe27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8107b91-24a4-4ca9-8ed6-951951cb5dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:06 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Volume volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85 (ec6c0024-4d49-4431-b17e-29ea8b7b5f85): created successfully Jul 14 13:09:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8107b91-24a4-4ca9-8ed6-951951cb5dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Flow 'volume_create_manager' (dff9e3fe-10a5-48a5-a4fe-46b14a917f13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:06 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-919c2bdf-d534-425b-802f-0dc02e1b25f5 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Created volume successfully. Jul 14 13:09:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-11655e3f-4436-483c-90d0-adf37efa2e97 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-11655e3f-4436-483c-90d0-adf37efa2e97 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:07 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-11655e3f-4436-483c-90d0-adf37efa2e97 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Creating offline snapshot af8c7c25-946b-4151-9555-09f2fe84425f of volume ec6c0024-4d49-4431-b17e-29ea8b7b5f85 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:09:07 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab755d03-ed8a-4320-9afd-89642e29d599]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11655e3f-4436-483c-90d0-adf37efa2e97 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:07 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85 Jul 14 13:09:07 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:07 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11655e3f-4436-483c-90d0-adf37efa2e97 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85" returned: 0 in 0.376s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11655e3f-4436-483c-90d0-adf37efa2e97 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.af8c7c25-946b-4151-9555-09f2fe84425f 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:07 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.af8c7c25-946b-4151-9555-09f2fe84425f 1G Jul 14 13:09:07 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:08 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11655e3f-4436-483c-90d0-adf37efa2e97 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.af8c7c25-946b-4151-9555-09f2fe84425f 1G" returned: 0 in 0.411s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11655e3f-4436-483c-90d0-adf37efa2e97 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.af8c7c25-946b-4151-9555-09f2fe84425f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:08 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.af8c7c25-946b-4151-9555-09f2fe84425f Jul 14 13:09:08 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:08 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11655e3f-4436-483c-90d0-adf37efa2e97 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.af8c7c25-946b-4151-9555-09f2fe84425f" returned: 0 in 0.306s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:08 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-11655e3f-4436-483c-90d0-adf37efa2e97 tempest-CreateVolumesFromSnapshotTest-1755036494 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.af8c7c25-946b-4151-9555-09f2fe84425f is being set with open permissions: ugo+rw Jul 14 13:09:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11655e3f-4436-483c-90d0-adf37efa2e97 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.af8c7c25-946b-4151-9555-09f2fe84425f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:08 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.af8c7c25-946b-4151-9555-09f2fe84425f Jul 14 13:09:08 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:08 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11655e3f-4436-483c-90d0-adf37efa2e97 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.af8c7c25-946b-4151-9555-09f2fe84425f" returned: 0 in 0.267s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11655e3f-4436-483c-90d0-adf37efa2e97 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:08 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.info Jul 14 13:09:08 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:09 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11655e3f-4436-483c-90d0-adf37efa2e97 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.info" returned: 0 in 0.272s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:09 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-11655e3f-4436-483c-90d0-adf37efa2e97 tempest-CreateVolumesFromSnapshotTest-1755036494 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.info is being set with open permissions: ugo+rw Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11655e3f-4436-483c-90d0-adf37efa2e97 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:09 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.info Jul 14 13:09:09 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:09 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11655e3f-4436-483c-90d0-adf37efa2e97 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.info" returned: 0 in 0.254s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-11655e3f-4436-483c-90d0-adf37efa2e97 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.988s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:09 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-11655e3f-4436-483c-90d0-adf37efa2e97 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Create snapshot completed successfully Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Flow 'volume_create_manager' (258c5218-c271-4c9e-a687-a0a20540adbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ffe542-53a2-42a9-a524-6ef3ee280d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ffe542-53a2-42a9-a524-6ef3ee280d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1248632948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88438b3-31d9-41b8-8b8a-1ae7977c50b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88d8597d8af2429ea43dd89ca3f2b4b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:10Z,use_quota=True,user_id='ab0c7d3585f542078a3faf73f6331500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(146db9bd-2862-4c7d-9317-9074b37ba74e),volume_type_id=146db9bd-2862-4c7d-9317-9074b37ba74e)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f1cfc1-cfd2-4c3e-a379-acb59fd21bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f1cfc1-cfd2-4c3e-a379-acb59fd21bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9858a729-d48f-4ced-9e74-5679311c2a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9858a729-d48f-4ced-9e74-5679311c2a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a88438b3-31d9-41b8-8b8a-1ae7977c50b8', 'volume_name': 'volume-a88438b3-31d9-41b8-8b8a-1ae7977c50b8', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b800a4-9ddf-47fe-95ec-dcae2e272dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b800a4-9ddf-47fe-95ec-dcae2e272dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a10e6ad-b047-4bc2-a66e-e13cb7a72fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:09 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Volume a88438b3-31d9-41b8-8b8a-1ae7977c50b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a88438b3-31d9-41b8-8b8a-1ae7977c50b8', 'volume_size': 1} Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1248632948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88438b3-31d9-41b8-8b8a-1ae7977c50b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88d8597d8af2429ea43dd89ca3f2b4b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:10Z,use_quota=True,user_id='ab0c7d3585f542078a3faf73f6331500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(146db9bd-2862-4c7d-9317-9074b37ba74e),volume_type_id=146db9bd-2862-4c7d-9317-9074b37ba74e)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Creating volume a88438b3-31d9-41b8-8b8a-1ae7977c50b8 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:09:09 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:09:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a88438b3-31d9-41b8-8b8a-1ae7977c50b8 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:09 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a88438b3-31d9-41b8-8b8a-1ae7977c50b8 1073741824 Jul 14 13:09:09 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Flow 'volume_create_manager' (5fdb592f-9614-4b32-8cd4-302cc0d9092d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69514749-a388-4383-b9bb-af8afd65edd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69514749-a388-4383-b9bb-af8afd65edd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1978536466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2e2a6a-be2a-4ba2-9795-41621e19b9f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac9bb41ff0d4f56834b7555b2b16403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:10Z,use_quota=True,user_id='5e8113e1c1fd45789fd594f09661f719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4677779-c065-40f0-aeb2-a1d3a9d21a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4677779-c065-40f0-aeb2-a1d3a9d21a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06dbde08-adb7-47c9-ac20-62b8cda331a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06dbde08-adb7-47c9-ac20-62b8cda331a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef2e2a6a-be2a-4ba2-9795-41621e19b9f4', 'volume_name': 'volume-ef2e2a6a-be2a-4ba2-9795-41621e19b9f4', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b0217d-f588-416e-810b-40c19cb566b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b0217d-f588-416e-810b-40c19cb566b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1322eb0b-ac59-4f55-940c-28aba117b9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:10 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Volume ef2e2a6a-be2a-4ba2-9795-41621e19b9f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef2e2a6a-be2a-4ba2-9795-41621e19b9f4', 'volume_size': 1} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Flow 'volume_create_manager' (3767c99c-ef12-4743-9b89-b65b5100696c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a816ed28-4d05-4c1a-b73d-052e8e8b606a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a816ed28-4d05-4c1a-b73d-052e8e8b606a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1514694944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414a408e-7cce-4788-895d-d6b21a8301e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88d8597d8af2429ea43dd89ca3f2b4b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:10Z,use_quota=True,user_id='ab0c7d3585f542078a3faf73f6331500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a98d0978-07a2-4048-9362-60a862851dad),volume_type_id=a98d0978-07a2-4048-9362-60a862851dad)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef219b4-dd1d-43fc-af81-ddab5aeb7b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef219b4-dd1d-43fc-af81-ddab5aeb7b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f461a3cb-8e54-4c7e-9f1b-02607bf01fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f461a3cb-8e54-4c7e-9f1b-02607bf01fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '414a408e-7cce-4788-895d-d6b21a8301e4', 'volume_name': 'volume-414a408e-7cce-4788-895d-d6b21a8301e4', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba104e2-5616-4691-a7eb-231afefe0cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba104e2-5616-4691-a7eb-231afefe0cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a775906-42cb-4cb3-a115-cce3915c89ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:10 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Volume 414a408e-7cce-4788-895d-d6b21a8301e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-414a408e-7cce-4788-895d-d6b21a8301e4', 'volume_size': 1} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:10 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a88438b3-31d9-41b8-8b8a-1ae7977c50b8 1073741824" returned: 0 in 0.633s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a88438b3-31d9-41b8-8b8a-1ae7977c50b8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:10 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a88438b3-31d9-41b8-8b8a-1ae7977c50b8 Jul 14 13:09:10 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Flow 'volume_create_manager' (87631e45-5bca-4697-95ab-4b9316607326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8d7c9a-d145-4ebe-b9a3-4b4d81cff4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8d7c9a-d145-4ebe-b9a3-4b4d81cff4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-84320287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b93cd4-195b-41fd-92e4-a1507484f851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac9bb41ff0d4f56834b7555b2b16403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:11Z,use_quota=True,user_id='5e8113e1c1fd45789fd594f09661f719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c06f9915-9f0b-40b5-8f0c-b4d9e4e1b346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c06f9915-9f0b-40b5-8f0c-b4d9e4e1b346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631cb67c-9262-4fc4-aea2-0900a0e07b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631cb67c-9262-4fc4-aea2-0900a0e07b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24b93cd4-195b-41fd-92e4-a1507484f851', 'volume_name': 'volume-24b93cd4-195b-41fd-92e4-a1507484f851', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2d9028-cd0b-439b-bf7a-8946164069d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2d9028-cd0b-439b-bf7a-8946164069d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd18db7a-51d0-4545-bd4d-1892207a8f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:10 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Volume 24b93cd4-195b-41fd-92e4-a1507484f851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24b93cd4-195b-41fd-92e4-a1507484f851', 'volume_size': 1} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:10 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a88438b3-31d9-41b8-8b8a-1ae7977c50b8" returned: 0 in 0.348s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.694s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1978536466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2e2a6a-be2a-4ba2-9795-41621e19b9f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac9bb41ff0d4f56834b7555b2b16403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:10Z,use_quota=True,user_id='5e8113e1c1fd45789fd594f09661f719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Creating volume ef2e2a6a-be2a-4ba2-9795-41621e19b9f4 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:09:10 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ef2e2a6a-be2a-4ba2-9795-41621e19b9f4 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a10e6ad-b047-4bc2-a66e-e13cb7a72fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a88438b3-31d9-41b8-8b8a-1ae7977c50b8', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:10 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ef2e2a6a-be2a-4ba2-9795-41621e19b9f4 1073741824 Jul 14 13:09:10 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d8210cb-cea2-4b4c-b633-a7465fe5f1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:10 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Volume volume-a88438b3-31d9-41b8-8b8a-1ae7977c50b8 (a88438b3-31d9-41b8-8b8a-1ae7977c50b8): created successfully Jul 14 13:09:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d8210cb-cea2-4b4c-b633-a7465fe5f1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Flow 'volume_create_manager' (258c5218-c271-4c9e-a687-a0a20540adbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:11 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-59b0e6a1-f76f-4469-922c-8b45fe103fda tempest-TestInstancesWithCinderVolumes-867500636 None] Created volume successfully. Jul 14 13:09:11 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ef2e2a6a-be2a-4ba2-9795-41621e19b9f4 1073741824" returned: 0 in 0.493s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ef2e2a6a-be2a-4ba2-9795-41621e19b9f4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:11 devstack sudo[101479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ef2e2a6a-be2a-4ba2-9795-41621e19b9f4 Jul 14 13:09:11 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Flow 'volume_create_manager' (3dc69f79-e1c0-4a03-b67b-609a0bda1fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a1f027-cc76-48a2-862c-3ed924e3605b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:11 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ef2e2a6a-be2a-4ba2-9795-41621e19b9f4" returned: 0 in 0.312s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a1f027-cc76-48a2-862c-3ed924e3605b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-963311648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fce8b2b8-9212-4feb-ae8c-ee46066be679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac9bb41ff0d4f56834b7555b2b16403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:12Z,use_quota=True,user_id='5e8113e1c1fd45789fd594f09661f719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d71609-cb61-422a-88e6-54255e9335a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d71609-cb61-422a-88e6-54255e9335a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3ee565-e53a-4db4-81bd-6ebbdf4ebfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3ee565-e53a-4db4-81bd-6ebbdf4ebfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fce8b2b8-9212-4feb-ae8c-ee46066be679', 'volume_name': 'volume-fce8b2b8-9212-4feb-ae8c-ee46066be679', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9e3a7e-9097-4f51-bed2-53d3b68c8e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9e3a7e-9097-4f51-bed2-53d3b68c8e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46831da-a0ea-46d6-acd6-9fc3a9bd1907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:11 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Volume fce8b2b8-9212-4feb-ae8c-ee46066be679: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fce8b2b8-9212-4feb-ae8c-ee46066be679', 'volume_size': 1} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-963311648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fce8b2b8-9212-4feb-ae8c-ee46066be679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac9bb41ff0d4f56834b7555b2b16403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:12Z,use_quota=True,user_id='5e8113e1c1fd45789fd594f09661f719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Creating volume fce8b2b8-9212-4feb-ae8c-ee46066be679 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:09:11 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce8b2b8-9212-4feb-ae8c-ee46066be679 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:09:11 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce8b2b8-9212-4feb-ae8c-ee46066be679 1073741824 Jul 14 13:09:11 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Flow 'volume_create_manager' (4bc84c51-a8a6-4df8-b068-967e4a527c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d48a3d7b-5012-4de6-85c2-79456deb61e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1322eb0b-ac59-4f55-940c-28aba117b9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef2e2a6a-be2a-4ba2-9795-41621e19b9f4', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf699a9-2286-4ae1-b342-d50d6de61d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Flow 'volume_create_manager' (3076d18b-74f2-492a-a6ad-4bbe8b6242f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764bd412-6271-49e8-b5f0-1f07a08cd8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d48a3d7b-5012-4de6-85c2-79456deb61e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-604492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04b59c2-00c0-4369-aa7c-764d49b6ff7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88d8597d8af2429ea43dd89ca3f2b4b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:12Z,use_quota=True,user_id='ab0c7d3585f542078a3faf73f6331500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e580f19d-06af-4630-a804-3ba0f36e2e27),volume_type_id=e580f19d-06af-4630-a804-3ba0f36e2e27)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea712e3d-e910-411d-b6a7-614dd5fab444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea712e3d-e910-411d-b6a7-614dd5fab444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea709c3-7f84-497e-971d-0cd7dd08e7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:11 devstack cinder-volume[86977]: DEBUG cinder.image.glance [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Creating Keystone auth plugin from conf {{(pid=86977) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 13:09:12 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Volume volume-ef2e2a6a-be2a-4ba2-9795-41621e19b9f4 (ef2e2a6a-be2a-4ba2-9795-41621e19b9f4): created successfully Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf699a9-2286-4ae1-b342-d50d6de61d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Flow 'volume_create_manager' (5fdb592f-9614-4b32-8cd4-302cc0d9092d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764bd412-6271-49e8-b5f0-1f07a08cd8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1908710814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5188ca3-126a-432f-a8fc-875c429e16a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac9bb41ff0d4f56834b7555b2b16403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:12Z,use_quota=True,user_id='5e8113e1c1fd45789fd594f09661f719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2ec328-1051-4160-aeca-0ec1177d6f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2ec328-1051-4160-aeca-0ec1177d6f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d56944c-ffc4-4eed-aad4-ee35ba6463dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d56944c-ffc4-4eed-aad4-ee35ba6463dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5188ca3-126a-432f-a8fc-875c429e16a8', 'volume_name': 'volume-e5188ca3-126a-432f-a8fc-875c429e16a8', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd44a320-7db8-4d05-8ff5-57daca8282da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd44a320-7db8-4d05-8ff5-57daca8282da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b79cf609-91cf-4ab1-a500-5dee79352836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:12 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Volume e5188ca3-126a-432f-a8fc-875c429e16a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5188ca3-126a-432f-a8fc-875c429e16a8', 'volume_size': 1} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:12 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-0220604e-4474-42ca-bc75-9873a85edf2f tempest-CreateVolumesFromSnapshotTest-1755036494 None] Created volume successfully. Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Flow 'volume_create_manager' (d755271d-5371-414f-b1ae-0413f45dad9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88947813-5bb1-4ca1-a421-c5b4e7737d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88947813-5bb1-4ca1-a421-c5b4e7737d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-219076396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac9bb41ff0d4f56834b7555b2b16403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:12Z,use_quota=True,user_id='5e8113e1c1fd45789fd594f09661f719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbab8623-2e4f-4511-8441-e56e6bf5a070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbab8623-2e4f-4511-8441-e56e6bf5a070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8f8570-07f4-4db7-9912-618a86f8430d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8f8570-07f4-4db7-9912-618a86f8430d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5', 'volume_name': 'volume-79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9bed78-7eda-4cf8-a745-844328abc53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9bed78-7eda-4cf8-a745-844328abc53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0167cd9a-03b2-4b5e-a3cc-e11a0137c605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:12 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Volume 79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5', 'volume_size': 1} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea709c3-7f84-497e-971d-0cd7dd08e7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e04b59c2-00c0-4369-aa7c-764d49b6ff7c', 'volume_name': 'volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c', 'volume_size': 1, 'image_id': '3deee429-d169-429c-8c4d-a6a205fb9d5a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3deee429-d169-429c-8c4d-a6a205fb9d5a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1713879368', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88d8597d8af2429ea43dd89ca3f2b4b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3deee429-d169-429c-8c4d-a6a205fb9d5a', 'created_at': datetime.datetime(2026, 7, 14, 11, 9, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 11, 9, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3deee429-d169-429c-8c4d-a6a205fb9d5a/file', 'properties': {}}, 'image_service': }' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb425d08-b08f-4fe0-a356-4b488c141723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb425d08-b08f-4fe0-a356-4b488c141723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e59829-3599-4216-a3b3-03544e021540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:12 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Volume e04b59c2-00c0-4369-aa7c-764d49b6ff7c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c', 'volume_size': 1, 'image_id': '3deee429-d169-429c-8c4d-a6a205fb9d5a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3deee429-d169-429c-8c4d-a6a205fb9d5a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1713879368', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88d8597d8af2429ea43dd89ca3f2b4b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3deee429-d169-429c-8c4d-a6a205fb9d5a', 'created_at': datetime.datetime(2026, 7, 14, 11, 9, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 11, 9, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3deee429-d169-429c-8c4d-a6a205fb9d5a/file', 'properties': {}}, 'image_service': } Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Trying to clone e04b59c2-00c0-4369-aa7c-764d49b6ff7c from image 3deee429-d169-429c-8c4d-a6a205fb9d5a at location (None, [{'url': 'file:///opt/stack/data/glance/images/3deee429-d169-429c-8c4d-a6a205fb9d5a', 'metadata': {}}]). {{(pid=86977) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 13:09:12 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce8b2b8-9212-4feb-ae8c-ee46066be679 1073741824" returned: 0 in 0.577s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce8b2b8-9212-4feb-ae8c-ee46066be679 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:12 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce8b2b8-9212-4feb-ae8c-ee46066be679 Jul 14 13:09:12 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:12 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce8b2b8-9212-4feb-ae8c-ee46066be679" returned: 0 in 0.313s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.029s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-84320287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b93cd4-195b-41fd-92e4-a1507484f851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac9bb41ff0d4f56834b7555b2b16403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:11Z,use_quota=True,user_id='5e8113e1c1fd45789fd594f09661f719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Creating volume 24b93cd4-195b-41fd-92e4-a1507484f851 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:09:12 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-24b93cd4-195b-41fd-92e4-a1507484f851 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46831da-a0ea-46d6-acd6-9fc3a9bd1907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fce8b2b8-9212-4feb-ae8c-ee46066be679', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e18316-58bb-4fe4-ba3c-02de5557005c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:12 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-24b93cd4-195b-41fd-92e4-a1507484f851 1073741824 Jul 14 13:09:12 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:12 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Volume volume-fce8b2b8-9212-4feb-ae8c-ee46066be679 (fce8b2b8-9212-4feb-ae8c-ee46066be679): created successfully Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e18316-58bb-4fe4-ba3c-02de5557005c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Flow 'volume_create_manager' (3dc69f79-e1c0-4a03-b67b-609a0bda1fc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:12 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b896f012-3714-4e6b-9d73-e54fc37bc5a3 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Created volume successfully. Jul 14 13:09:13 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-24b93cd4-195b-41fd-92e4-a1507484f851 1073741824" returned: 0 in 0.528s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-24b93cd4-195b-41fd-92e4-a1507484f851 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:13 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-24b93cd4-195b-41fd-92e4-a1507484f851 Jul 14 13:09:13 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:13 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-24b93cd4-195b-41fd-92e4-a1507484f851" returned: 0 in 0.303s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:09:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.245s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1514694944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414a408e-7cce-4788-895d-d6b21a8301e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88d8597d8af2429ea43dd89ca3f2b4b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:10Z,use_quota=True,user_id='ab0c7d3585f542078a3faf73f6331500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a98d0978-07a2-4048-9362-60a862851dad),volume_type_id=a98d0978-07a2-4048-9362-60a862851dad)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:09:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Creating volume 414a408e-7cce-4788-895d-d6b21a8301e4 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:09:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:09:13 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:09:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-414a408e-7cce-4788-895d-d6b21a8301e4 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd18db7a-51d0-4545-bd4d-1892207a8f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24b93cd4-195b-41fd-92e4-a1507484f851', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:13 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-414a408e-7cce-4788-895d-d6b21a8301e4 1073741824 Jul 14 13:09:13 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80fe51ea-97c6-4bcf-9827-c30b76a33b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:13 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Volume volume-24b93cd4-195b-41fd-92e4-a1507484f851 (24b93cd4-195b-41fd-92e4-a1507484f851): created successfully Jul 14 13:09:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80fe51ea-97c6-4bcf-9827-c30b76a33b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Flow 'volume_create_manager' (87631e45-5bca-4697-95ab-4b9316607326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:13 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-1fe32373-794f-4044-b6ee-996231e59ce8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Created volume successfully. Jul 14 13:09:14 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-414a408e-7cce-4788-895d-d6b21a8301e4 1073741824" returned: 0 in 0.572s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-414a408e-7cce-4788-895d-d6b21a8301e4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:14 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-414a408e-7cce-4788-895d-d6b21a8301e4 Jul 14 13:09:14 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:14 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-414a408e-7cce-4788-895d-d6b21a8301e4" returned: 0 in 0.303s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:09:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.553s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1908710814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5188ca3-126a-432f-a8fc-875c429e16a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac9bb41ff0d4f56834b7555b2b16403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:12Z,use_quota=True,user_id='5e8113e1c1fd45789fd594f09661f719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:09:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Creating volume e5188ca3-126a-432f-a8fc-875c429e16a8 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:09:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:09:14 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:09:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e5188ca3-126a-432f-a8fc-875c429e16a8 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:14 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e5188ca3-126a-432f-a8fc-875c429e16a8 1073741824 Jul 14 13:09:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a775906-42cb-4cb3-a115-cce3915c89ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-414a408e-7cce-4788-895d-d6b21a8301e4', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:14 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ccc2b9-9d25-44fe-ba75-d5a5b7fb5d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:14 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Volume volume-414a408e-7cce-4788-895d-d6b21a8301e4 (414a408e-7cce-4788-895d-d6b21a8301e4): created successfully Jul 14 13:09:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ccc2b9-9d25-44fe-ba75-d5a5b7fb5d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Flow 'volume_create_manager' (3767c99c-ef12-4743-9b89-b65b5100696c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:14 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-5e8dde58-6123-42ea-aaf1-259f04eb94d4 tempest-TestInstancesWithCinderVolumes-867500636 None] Created volume successfully. Jul 14 13:09:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-4b33f6e0-0857-4803-b217-1919f0e39162 req-f20e4318-5256-4f64-a797-04814aeea963 tempest-TestStampPattern-831248066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:15 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e5188ca3-126a-432f-a8fc-875c429e16a8 1073741824" returned: 0 in 0.531s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e5188ca3-126a-432f-a8fc-875c429e16a8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:15 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e5188ca3-126a-432f-a8fc-875c429e16a8 Jul 14 13:09:15 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:15 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e5188ca3-126a-432f-a8fc-875c429e16a8" returned: 0 in 0.248s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:09:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.276s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-219076396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac9bb41ff0d4f56834b7555b2b16403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:12Z,use_quota=True,user_id='5e8113e1c1fd45789fd594f09661f719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:09:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Creating volume 79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:09:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:09:15 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:09:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b79cf609-91cf-4ab1-a500-5dee79352836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5188ca3-126a-432f-a8fc-875c429e16a8', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:15 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5 1073741824 Jul 14 13:09:15 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc787fd-66d2-43eb-9716-0d21f19fc78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:15 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Volume volume-e5188ca3-126a-432f-a8fc-875c429e16a8 (e5188ca3-126a-432f-a8fc-875c429e16a8): created successfully Jul 14 13:09:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc787fd-66d2-43eb-9716-0d21f19fc78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Flow 'volume_create_manager' (3076d18b-74f2-492a-a6ad-4bbe8b6242f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:15 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e18f160d-5ccd-447c-bcf7-2fae1f6164b1 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Created volume successfully. Jul 14 13:09:15 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5 1073741824" returned: 0 in 0.439s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:15 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5 Jul 14 13:09:15 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:16 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5" returned: 0 in 0.265s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-4b33f6e0-0857-4803-b217-1919f0e39162 req-f20e4318-5256-4f64-a797-04814aeea963 tempest-TestStampPattern-831248066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.123s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0167cd9a-03b2-4b5e-a3cc-e11a0137c605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3faa475a-816b-404d-9d87-f0e0e5a94fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbc6a40-7e86-4659-a7f6-b03775211eec]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-4b33f6e0-0857-4803-b217-1919f0e39162 req-f20e4318-5256-4f64-a797-04814aeea963 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f94fb295-ec42-43be-9610-6e944b85c605 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:16 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Volume volume-79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5 (79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5): created successfully Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3faa475a-816b-404d-9d87-f0e0e5a94fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Flow 'volume_create_manager' (d755271d-5371-414f-b1ae-0413f45dad9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:16 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-ec30029a-75ea-4b6e-9103-7def442b55a8 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Created volume successfully. Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3deee429-d169-429c-8c4d-a6a205fb9d5a_kvi5wgftdevstack@QuobyteHD, size 20.69 MB, duration 4.03 sec {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:751}} Jul 14 13:09:16 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Image download 20.69 MB at 5.13 MB/s Jul 14 13:09:16 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f94fb295-ec42-43be-9610-6e944b85c605 Jul 14 13:09:16 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec9efbb-5a22-4173-a498-fe5aa94f97b1]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3deee429-d169-429c-8c4d-a6a205fb9d5a_kvi5wgftdevstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:16 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3deee429-d169-429c-8c4d-a6a205fb9d5a_kvi5wgftdevstack@QuobyteHD Jul 14 13:09:16 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:16 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:09:16 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:16 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-4b33f6e0-0857-4803-b217-1919f0e39162 req-f20e4318-5256-4f64-a797-04814aeea963 tempest-TestStampPattern-831248066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f94fb295-ec42-43be-9610-6e944b85c605" returned: 0 in 0.372s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-4b33f6e0-0857-4803-b217-1919f0e39162 req-f20e4318-5256-4f64-a797-04814aeea963 tempest-TestStampPattern-831248066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.402s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-4b33f6e0-0857-4803-b217-1919f0e39162 req-f20e4318-5256-4f64-a797-04814aeea963 tempest-TestStampPattern-831248066 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1', 'name': 'volume-f94fb295-ec42-43be-9610-6e944b85c605', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec503acb-d284-4814-b368-880ce5ba03e6', 'enforce_multipath': True} {{(pid=86977) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 13:09:16 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3deee429-d169-429c-8c4d-a6a205fb9d5a_kvi5wgftdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Temporary image 3deee429-d169-429c-8c4d-a6a205fb9d5a is fetched for user ab0c7d3585f542078a3faf73f6331500. {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:1450}} Jul 14 13:09:16 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-4b33f6e0-0857-4803-b217-1919f0e39162 req-f20e4318-5256-4f64-a797-04814aeea963 tempest-TestStampPattern-831248066 None] attachment_update completed successfully. Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[593ad850-6dfe-4370-a749-c267c7e0c595]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3deee429-d169-429c-8c4d-a6a205fb9d5a_kvi5wgftdevstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:16 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.277s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 28 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 13:09:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 13:09:16 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3deee429-d169-429c-8c4d-a6a205fb9d5a_kvi5wgftdevstack@QuobyteHD Jul 14 13:09:16 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:17 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3deee429-d169-429c-8c4d-a6a205fb9d5a_kvi5wgftdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-604492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04b59c2-00c0-4369-aa7c-764d49b6ff7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88d8597d8af2429ea43dd89ca3f2b4b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:12Z,use_quota=True,user_id='ab0c7d3585f542078a3faf73f6331500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e580f19d-06af-4630-a804-3ba0f36e2e27),volume_type_id=e580f19d-06af-4630-a804-3ba0f36e2e27)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:09:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Creating volume e04b59c2-00c0-4369-aa7c-764d49b6ff7c {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:09:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:09:17 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:09:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:17 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c 1073741824 Jul 14 13:09:17 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-55e499e5-e681-4fd8-b54c-d57c0e99cc4c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "cinder-79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-55e499e5-e681-4fd8-b54c-d57c0e99cc4c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-55e499e5-e681-4fd8-b54c-d57c0e99cc4c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "cinder-quobyte-79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-55e499e5-e681-4fd8-b54c-d57c0e99cc4c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-quobyte-79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5" acquired by "delete_volume" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:17 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0358f0b-4c20-456a-bfa0-8674d209cb6d]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-55e499e5-e681-4fd8-b54c-d57c0e99cc4c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:17 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5 Jul 14 13:09:17 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:17 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c 1073741824" returned: 0 in 0.527s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:17 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c Jul 14 13:09:17 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:17 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-55e499e5-e681-4fd8-b54c-d57c0e99cc4c tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5" returned: 0 in 0.368s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-55e499e5-e681-4fd8-b54c-d57c0e99cc4c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:17 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5 Jul 14 13:09:17 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:17 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c" returned: 0 in 0.268s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Attempting download of 3deee429-d169-429c-8c4d-a6a205fb9d5a ((None, [{'url': 'file:///opt/stack/data/glance/images/3deee429-d169-429c-8c4d-a6a205fb9d5a', 'metadata': {}}])) to volume e04b59c2-00c0-4369-aa7c-764d49b6ff7c. {{(pid=86977) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b0ebd2-4dba-4f7e-aecb-fb9067ff1485]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3deee429-d169-429c-8c4d-a6a205fb9d5a_d5q29ayc {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:18 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-55e499e5-e681-4fd8-b54c-d57c0e99cc4c tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5" returned: 0 in 0.270s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:18 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3deee429-d169-429c-8c4d-a6a205fb9d5a_d5q29ayc Jul 14 13:09:18 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-55e499e5-e681-4fd8-b54c-d57c0e99cc4c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-quobyte-79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5" released by "delete_volume" :: held 0.685s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-55e499e5-e681-4fd8-b54c-d57c0e99cc4c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Created reservations ['68a714b4-c00c-4c25-9cac-c108a010497e', 'dcd5ad8c-54ad-4b65-9830-62cfc7dab2f0', '092b6b4c-e931-4632-84ab-66b0b1035b61', '87d07b07-aec5-4a1e-b609-b0c3f9b55da9'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-55e499e5-e681-4fd8-b54c-d57c0e99cc4c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-55e499e5-e681-4fd8-b54c-d57c0e99cc4c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-55e499e5-e681-4fd8-b54c-d57c0e99cc4c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-55e499e5-e681-4fd8-b54c-d57c0e99cc4c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-55e499e5-e681-4fd8-b54c-d57c0e99cc4c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-55e499e5-e681-4fd8-b54c-d57c0e99cc4c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:18 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:09:18 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:18 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3deee429-d169-429c-8c4d-a6a205fb9d5a_d5q29ayc" returned: 0 in 0.352s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3deee429-d169-429c-8c4d-a6a205fb9d5a_d5q29ayc {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:18 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3deee429-d169-429c-8c4d-a6a205fb9d5a_d5q29ayc Jul 14 13:09:18 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-aebc73c3-52ca-491f-b5e4-2dc6e211312d tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "cinder-e5188ca3-126a-432f-a8fc-875c429e16a8-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-aebc73c3-52ca-491f-b5e4-2dc6e211312d tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-e5188ca3-126a-432f-a8fc-875c429e16a8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:18 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-55e499e5-e681-4fd8-b54c-d57c0e99cc4c tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.337s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-55e499e5-e681-4fd8-b54c-d57c0e99cc4c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:09:18 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-55e499e5-e681-4fd8-b54c-d57c0e99cc4c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Deleted volume successfully. Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-aebc73c3-52ca-491f-b5e4-2dc6e211312d tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "cinder-quobyte-e5188ca3-126a-432f-a8fc-875c429e16a8" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-55e499e5-e681-4fd8-b54c-d57c0e99cc4c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-79fdb79d-f1ea-458e-a9d9-f24e0a58a5e5-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-aebc73c3-52ca-491f-b5e4-2dc6e211312d tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-quobyte-e5188ca3-126a-432f-a8fc-875c429e16a8" acquired by "delete_volume" :: waited 0.024s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[342a15d2-4ad9-4221-a701-fb287b4fab66]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aebc73c3-52ca-491f-b5e4-2dc6e211312d tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e5188ca3-126a-432f-a8fc-875c429e16a8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:18 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3deee429-d169-429c-8c4d-a6a205fb9d5a_d5q29ayc" returned: 1 in 0.394s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3deee429-d169-429c-8c4d-a6a205fb9d5a_d5q29ayc' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25a2850-34fd-46f6-ad45-78be4584e428]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3deee429-d169-429c-8c4d-a6a205fb9d5a_kvi5wgftdevstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:18 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e5188ca3-126a-432f-a8fc-875c429e16a8 Jul 14 13:09:18 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:18 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3deee429-d169-429c-8c4d-a6a205fb9d5a_kvi5wgftdevstack@QuobyteHD Jul 14 13:09:18 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:19 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aebc73c3-52ca-491f-b5e4-2dc6e211312d tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e5188ca3-126a-432f-a8fc-875c429e16a8" returned: 0 in 0.420s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aebc73c3-52ca-491f-b5e4-2dc6e211312d tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e5188ca3-126a-432f-a8fc-875c429e16a8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:19 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3deee429-d169-429c-8c4d-a6a205fb9d5a_kvi5wgftdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:19 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] 3deee429-d169-429c-8c4d-a6a205fb9d5a was qcow2, converting to raw {{(pid=86977) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1139}} Jul 14 13:09:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3deee429-d169-429c-8c4d-a6a205fb9d5a_kvi5wgftdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:19 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e5188ca3-126a-432f-a8fc-875c429e16a8 Jul 14 13:09:19 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:19 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3deee429-d169-429c-8c4d-a6a205fb9d5a_kvi5wgftdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c Jul 14 13:09:19 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:19 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aebc73c3-52ca-491f-b5e4-2dc6e211312d tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e5188ca3-126a-432f-a8fc-875c429e16a8" returned: 0 in 0.286s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-aebc73c3-52ca-491f-b5e4-2dc6e211312d tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-quobyte-e5188ca3-126a-432f-a8fc-875c429e16a8" released by "delete_volume" :: held 0.756s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:19 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-aebc73c3-52ca-491f-b5e4-2dc6e211312d tempest-CreateVolumesFromSnapshotTest-1755036494 None] Created reservations ['493b86be-3c72-43a1-aea5-e8c08593c2d5', 'd08572ca-1a3e-48ea-a9dd-e03c442a0870', 'c29fc732-f9c4-4d3e-9ddd-ff0bb64d1f9b', '8881b36a-d3ed-46ee-8b6c-7555c2e767a2'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:09:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aebc73c3-52ca-491f-b5e4-2dc6e211312d tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aebc73c3-52ca-491f-b5e4-2dc6e211312d tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-aebc73c3-52ca-491f-b5e4-2dc6e211312d tempest-CreateVolumesFromSnapshotTest-1755036494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-aebc73c3-52ca-491f-b5e4-2dc6e211312d tempest-CreateVolumesFromSnapshotTest-1755036494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aebc73c3-52ca-491f-b5e4-2dc6e211312d tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aebc73c3-52ca-491f-b5e4-2dc6e211312d tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:19 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:09:19 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:19 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-a7c2349e-9a57-44c0-a9af-8279f76aff47 req-9de76421-00cc-485f-88ee-f74e2ed84a53 tempest-TestStampPattern-831248066 None] Terminate volume connection completed successfully. Jul 14 13:09:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-a7c2349e-9a57-44c0-a9af-8279f76aff47 req-9de76421-00cc-485f-88ee-f74e2ed84a53 tempest-TestStampPattern-831248066 None] Deleting attachment ec503acb-d284-4814-b368-880ce5ba03e6. {{(pid=86977) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 13:09:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d468a700-a6d9-469a-aa0c-8f75e4ff0f6c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "cinder-fce8b2b8-9212-4feb-ae8c-ee46066be679-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d468a700-a6d9-469a-aa0c-8f75e4ff0f6c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-fce8b2b8-9212-4feb-ae8c-ee46066be679-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d468a700-a6d9-469a-aa0c-8f75e4ff0f6c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "cinder-quobyte-fce8b2b8-9212-4feb-ae8c-ee46066be679" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d468a700-a6d9-469a-aa0c-8f75e4ff0f6c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-quobyte-fce8b2b8-9212-4feb-ae8c-ee46066be679" acquired by "delete_volume" :: waited 0.014s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:19 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[f699a7c5-9401-4295-9990-4757e03f93cb]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d468a700-a6d9-469a-aa0c-8f75e4ff0f6c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce8b2b8-9212-4feb-ae8c-ee46066be679 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:20 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aebc73c3-52ca-491f-b5e4-2dc6e211312d tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.349s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:20 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-aebc73c3-52ca-491f-b5e4-2dc6e211312d tempest-CreateVolumesFromSnapshotTest-1755036494 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:09:20 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-aebc73c3-52ca-491f-b5e4-2dc6e211312d tempest-CreateVolumesFromSnapshotTest-1755036494 None] Deleted volume successfully. Jul 14 13:09:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-aebc73c3-52ca-491f-b5e4-2dc6e211312d tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-e5188ca3-126a-432f-a8fc-875c429e16a8-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:20 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce8b2b8-9212-4feb-ae8c-ee46066be679 Jul 14 13:09:20 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:20 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d468a700-a6d9-469a-aa0c-8f75e4ff0f6c tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce8b2b8-9212-4feb-ae8c-ee46066be679" returned: 0 in 0.444s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d468a700-a6d9-469a-aa0c-8f75e4ff0f6c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce8b2b8-9212-4feb-ae8c-ee46066be679 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:20 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce8b2b8-9212-4feb-ae8c-ee46066be679 Jul 14 13:09:20 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:20 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d468a700-a6d9-469a-aa0c-8f75e4ff0f6c tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-fce8b2b8-9212-4feb-ae8c-ee46066be679" returned: 0 in 0.270s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d468a700-a6d9-469a-aa0c-8f75e4ff0f6c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-quobyte-fce8b2b8-9212-4feb-ae8c-ee46066be679" released by "delete_volume" :: held 0.765s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:20 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-d468a700-a6d9-469a-aa0c-8f75e4ff0f6c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Created reservations ['a1bc873e-bee9-4c7f-b9c4-b91ad32d1652', '4f674299-d180-4499-ab01-1a2f10f631c4', 'ac07e90c-2202-4514-95a8-8a8f043927fd', 'e5f304e8-7d01-4c07-8148-9b543f070a4a'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:09:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d468a700-a6d9-469a-aa0c-8f75e4ff0f6c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d468a700-a6d9-469a-aa0c-8f75e4ff0f6c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d468a700-a6d9-469a-aa0c-8f75e4ff0f6c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d468a700-a6d9-469a-aa0c-8f75e4ff0f6c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d468a700-a6d9-469a-aa0c-8f75e4ff0f6c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d468a700-a6d9-469a-aa0c-8f75e4ff0f6c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:20 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:09:20 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:21 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3deee429-d169-429c-8c4d-a6a205fb9d5a_kvi5wgftdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c" returned: 0 in 1.811s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:21 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3deee429-d169-429c-8c4d-a6a205fb9d5a_kvi5wgftdevstack@QuobyteHD, size 112.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:09:21 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Converted 112.00 MB image at 61.79 MB/s Jul 14 13:09:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:21 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c 1G Jul 14 13:09:21 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0492fa8e-0647-40ed-8f5d-b01fd861aa12 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "cinder-24b93cd4-195b-41fd-92e4-a1507484f851-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0492fa8e-0647-40ed-8f5d-b01fd861aa12 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-24b93cd4-195b-41fd-92e4-a1507484f851-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0492fa8e-0647-40ed-8f5d-b01fd861aa12 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "cinder-quobyte-24b93cd4-195b-41fd-92e4-a1507484f851" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0492fa8e-0647-40ed-8f5d-b01fd861aa12 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-quobyte-24b93cd4-195b-41fd-92e4-a1507484f851" acquired by "delete_volume" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:21 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb7324b-5338-4608-a4ff-4f92236966e4]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0492fa8e-0647-40ed-8f5d-b01fd861aa12 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-24b93cd4-195b-41fd-92e4-a1507484f851 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:21 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d468a700-a6d9-469a-aa0c-8f75e4ff0f6c tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.423s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:21 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-d468a700-a6d9-469a-aa0c-8f75e4ff0f6c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:09:21 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-d468a700-a6d9-469a-aa0c-8f75e4ff0f6c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Deleted volume successfully. Jul 14 13:09:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d468a700-a6d9-469a-aa0c-8f75e4ff0f6c tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-fce8b2b8-9212-4feb-ae8c-ee46066be679-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:21 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-24b93cd4-195b-41fd-92e4-a1507484f851 Jul 14 13:09:21 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:21 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c 1G" returned: 0 in 0.454s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:21 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17f4345-a2f3-425a-915b-a760797728d9]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:21 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c Jul 14 13:09:21 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:21 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0492fa8e-0647-40ed-8f5d-b01fd861aa12 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-24b93cd4-195b-41fd-92e4-a1507484f851" returned: 0 in 0.575s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0492fa8e-0647-40ed-8f5d-b01fd861aa12 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-24b93cd4-195b-41fd-92e4-a1507484f851 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:21 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-24b93cd4-195b-41fd-92e4-a1507484f851 Jul 14 13:09:21 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:22 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c" returned: 0 in 0.576s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:22 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0492fa8e-0647-40ed-8f5d-b01fd861aa12 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-24b93cd4-195b-41fd-92e4-a1507484f851" returned: 0 in 0.470s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0492fa8e-0647-40ed-8f5d-b01fd861aa12 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-quobyte-24b93cd4-195b-41fd-92e4-a1507484f851" released by "delete_volume" :: held 1.124s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:22 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c Jul 14 13:09:22 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-0492fa8e-0647-40ed-8f5d-b01fd861aa12 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Created reservations ['75a478d6-bec2-4431-891d-7a301b86bff8', '9273778a-b443-4cab-bdce-ae2b147ebe19', 'a6de1919-171c-45ac-b376-67f17af09f68', '9c9f6efc-8591-4762-b86e-35cf0966c9fb'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0492fa8e-0647-40ed-8f5d-b01fd861aa12 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0492fa8e-0647-40ed-8f5d-b01fd861aa12 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0492fa8e-0647-40ed-8f5d-b01fd861aa12 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0492fa8e-0647-40ed-8f5d-b01fd861aa12 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0492fa8e-0647-40ed-8f5d-b01fd861aa12 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0492fa8e-0647-40ed-8f5d-b01fd861aa12 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:22 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:09:22 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:22 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c" returned: 1 in 0.570s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Downloaded image 3deee429-d169-429c-8c4d-a6a205fb9d5a ((None, [{'url': 'file:///opt/stack/data/glance/images/3deee429-d169-429c-8c4d-a6a205fb9d5a', 'metadata': {}}])) to volume e04b59c2-00c0-4369-aa7c-764d49b6ff7c successfully. {{(pid=86977) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Temporary image 3deee429-d169-429c-8c4d-a6a205fb9d5a for user ab0c7d3585f542078a3faf73f6331500 is deleted. {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:1454}} Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Marking volume e04b59c2-00c0-4369-aa7c-764d49b6ff7c as bootable. {{(pid=86977) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Copying metadata from image 3deee429-d169-429c-8c4d-a6a205fb9d5a to e04b59c2-00c0-4369-aa7c-764d49b6ff7c. {{(pid=86977) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Creating volume glance metadata for volume e04b59c2-00c0-4369-aa7c-764d49b6ff7c backed by image 3deee429-d169-429c-8c4d-a6a205fb9d5a with: {'image_id': '3deee429-d169-429c-8c4d-a6a205fb9d5a', 'image_name': 'tempest-scenario-img--1713879368', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86977) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e59829-3599-4216-a3b3-03544e021540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c', 'volume_size': 1, 'image_id': '3deee429-d169-429c-8c4d-a6a205fb9d5a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3deee429-d169-429c-8c4d-a6a205fb9d5a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1713879368', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88d8597d8af2429ea43dd89ca3f2b4b4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3deee429-d169-429c-8c4d-a6a205fb9d5a', 'created_at': datetime.datetime(2026, 7, 14, 11, 9, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 11, 9, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3deee429-d169-429c-8c4d-a6a205fb9d5a/file', 'properties': {}}, 'image_service': }' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (790f097b-2ac2-49eb-93bb-4452f7f613ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:22 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Volume volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c (e04b59c2-00c0-4369-aa7c-764d49b6ff7c): created successfully Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (790f097b-2ac2-49eb-93bb-4452f7f613ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:22 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Flow 'volume_create_manager' (4bc84c51-a8a6-4df8-b068-967e4a527c13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0492fa8e-0647-40ed-8f5d-b01fd861aa12 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.360s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-0492fa8e-0647-40ed-8f5d-b01fd861aa12 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:09:22 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-0492fa8e-0647-40ed-8f5d-b01fd861aa12 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Deleted volume successfully. Jul 14 13:09:22 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-fccaf68b-9e49-4588-b703-a422fcc9bc56 tempest-TestInstancesWithCinderVolumes-867500636 None] Created volume successfully. Jul 14 13:09:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0492fa8e-0647-40ed-8f5d-b01fd861aa12 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-24b93cd4-195b-41fd-92e4-a1507484f851-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f4f4ac9d-ebb5-4b28-87ad-bcb61c1a4337 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "cinder-ef2e2a6a-be2a-4ba2-9795-41621e19b9f4-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f4f4ac9d-ebb5-4b28-87ad-bcb61c1a4337 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-ef2e2a6a-be2a-4ba2-9795-41621e19b9f4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f4f4ac9d-ebb5-4b28-87ad-bcb61c1a4337 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "cinder-quobyte-ef2e2a6a-be2a-4ba2-9795-41621e19b9f4" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f4f4ac9d-ebb5-4b28-87ad-bcb61c1a4337 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-quobyte-ef2e2a6a-be2a-4ba2-9795-41621e19b9f4" acquired by "delete_volume" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:23 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[2914bd15-045c-484b-bd49-e8b1e542caf9]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f4f4ac9d-ebb5-4b28-87ad-bcb61c1a4337 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ef2e2a6a-be2a-4ba2-9795-41621e19b9f4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:23 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ef2e2a6a-be2a-4ba2-9795-41621e19b9f4 Jul 14 13:09:23 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:23 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f4f4ac9d-ebb5-4b28-87ad-bcb61c1a4337 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ef2e2a6a-be2a-4ba2-9795-41621e19b9f4" returned: 0 in 0.392s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f4f4ac9d-ebb5-4b28-87ad-bcb61c1a4337 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ef2e2a6a-be2a-4ba2-9795-41621e19b9f4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:23 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ef2e2a6a-be2a-4ba2-9795-41621e19b9f4 Jul 14 13:09:23 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:24 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f4f4ac9d-ebb5-4b28-87ad-bcb61c1a4337 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ef2e2a6a-be2a-4ba2-9795-41621e19b9f4" returned: 0 in 0.271s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f4f4ac9d-ebb5-4b28-87ad-bcb61c1a4337 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-quobyte-ef2e2a6a-be2a-4ba2-9795-41621e19b9f4" released by "delete_volume" :: held 0.706s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-f4f4ac9d-ebb5-4b28-87ad-bcb61c1a4337 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Created reservations ['117b4334-c7cc-4451-9801-f9612fd395cf', 'b04369ed-9947-46b7-b6cf-d65e799908ba', '385c9d55-8699-497b-939e-cb3410a42930', '811813de-2885-4d92-8664-e453d2f48296'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f4f4ac9d-ebb5-4b28-87ad-bcb61c1a4337 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f4f4ac9d-ebb5-4b28-87ad-bcb61c1a4337 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f4f4ac9d-ebb5-4b28-87ad-bcb61c1a4337 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f4f4ac9d-ebb5-4b28-87ad-bcb61c1a4337 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f4f4ac9d-ebb5-4b28-87ad-bcb61c1a4337 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f4f4ac9d-ebb5-4b28-87ad-bcb61c1a4337 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b701abf9-1b9d-4836-94e4-ad9f7688b452 tempest-TestStampPattern-831248066 None] Acquiring lock "cinder-f94fb295-ec42-43be-9610-6e944b85c605-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:24 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:09:24 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b701abf9-1b9d-4836-94e4-ad9f7688b452 tempest-TestStampPattern-831248066 None] Lock "cinder-f94fb295-ec42-43be-9610-6e944b85c605-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b701abf9-1b9d-4836-94e4-ad9f7688b452 tempest-TestStampPattern-831248066 None] Acquiring lock "cinder-quobyte-f94fb295-ec42-43be-9610-6e944b85c605" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b701abf9-1b9d-4836-94e4-ad9f7688b452 tempest-TestStampPattern-831248066 None] Lock "cinder-quobyte-f94fb295-ec42-43be-9610-6e944b85c605" acquired by "delete_volume" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[637f2895-ebc7-4911-9a7b-19b4de8ad97d]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b701abf9-1b9d-4836-94e4-ad9f7688b452 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f94fb295-ec42-43be-9610-6e944b85c605 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3d5e9ff0-37ed-4f57-977a-629cf35c04ac tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "cinder-af8c7c25-946b-4151-9555-09f2fe84425f-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3d5e9ff0-37ed-4f57-977a-629cf35c04ac tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-af8c7c25-946b-4151-9555-09f2fe84425f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3d5e9ff0-37ed-4f57-977a-629cf35c04ac tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "cinder-quobyte-ec6c0024-4d49-4431-b17e-29ea8b7b5f85" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3d5e9ff0-37ed-4f57-977a-629cf35c04ac tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-quobyte-ec6c0024-4d49-4431-b17e-29ea8b7b5f85" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3d5e9ff0-37ed-4f57-977a-629cf35c04ac tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "cinder-quobyte-af8c7c25-946b-4151-9555-09f2fe84425f" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3d5e9ff0-37ed-4f57-977a-629cf35c04ac tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-quobyte-af8c7c25-946b-4151-9555-09f2fe84425f" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-3d5e9ff0-37ed-4f57-977a-629cf35c04ac tempest-CreateVolumesFromSnapshotTest-1755036494 None] Deleting offline snapshot af8c7c25-946b-4151-9555-09f2fe84425f of volume ec6c0024-4d49-4431-b17e-29ea8b7b5f85 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:09:24 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f94fb295-ec42-43be-9610-6e944b85c605 Jul 14 13:09:24 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-3d5e9ff0-37ed-4f57-977a-629cf35c04ac tempest-CreateVolumesFromSnapshotTest-1755036494 None] snapshot_file for this snap is: volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.af8c7c25-946b-4151-9555-09f2fe84425f {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f6fea4-da0f-492c-9063-4dc3e4f484a3]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3d5e9ff0-37ed-4f57-977a-629cf35c04ac tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.af8c7c25-946b-4151-9555-09f2fe84425f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:24 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f4f4ac9d-ebb5-4b28-87ad-bcb61c1a4337 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.472s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-f4f4ac9d-ebb5-4b28-87ad-bcb61c1a4337 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:09:24 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-f4f4ac9d-ebb5-4b28-87ad-bcb61c1a4337 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Deleted volume successfully. Jul 14 13:09:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f4f4ac9d-ebb5-4b28-87ad-bcb61c1a4337 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-ef2e2a6a-be2a-4ba2-9795-41621e19b9f4-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:24 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.af8c7c25-946b-4151-9555-09f2fe84425f Jul 14 13:09:24 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:25 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b701abf9-1b9d-4836-94e4-ad9f7688b452 tempest-TestStampPattern-831248066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f94fb295-ec42-43be-9610-6e944b85c605" returned: 0 in 0.474s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b701abf9-1b9d-4836-94e4-ad9f7688b452 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f94fb295-ec42-43be-9610-6e944b85c605 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:25 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f94fb295-ec42-43be-9610-6e944b85c605 Jul 14 13:09:25 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:25 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3d5e9ff0-37ed-4f57-977a-629cf35c04ac tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.af8c7c25-946b-4151-9555-09f2fe84425f" returned: 0 in 0.422s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-3d5e9ff0-37ed-4f57-977a-629cf35c04ac tempest-CreateVolumesFromSnapshotTest-1755036494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:09:25 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b32a20-448a-42b8-87e2-d8dcd5d4bfdc]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3d5e9ff0-37ed-4f57-977a-629cf35c04ac tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:25 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b701abf9-1b9d-4836-94e4-ad9f7688b452 tempest-TestStampPattern-831248066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f94fb295-ec42-43be-9610-6e944b85c605" returned: 0 in 0.305s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b701abf9-1b9d-4836-94e4-ad9f7688b452 tempest-TestStampPattern-831248066 None] Lock "cinder-quobyte-f94fb295-ec42-43be-9610-6e944b85c605" released by "delete_volume" :: held 0.859s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:25 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85 Jul 14 13:09:25 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:25 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-b701abf9-1b9d-4836-94e4-ad9f7688b452 tempest-TestStampPattern-831248066 None] Created reservations ['c133973f-0ec4-4bf2-88c5-2d1d4173275b', 'cb70c9ae-287f-4c4f-9569-5c4a1e61c7c2', '9d259b75-ed54-45dc-b5c5-2608f25b75f6', 'fc91986c-514e-4f07-a524-9270d37ebf79'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:09:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b701abf9-1b9d-4836-94e4-ad9f7688b452 tempest-TestStampPattern-831248066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b701abf9-1b9d-4836-94e4-ad9f7688b452 tempest-TestStampPattern-831248066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b701abf9-1b9d-4836-94e4-ad9f7688b452 tempest-TestStampPattern-831248066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b701abf9-1b9d-4836-94e4-ad9f7688b452 tempest-TestStampPattern-831248066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b701abf9-1b9d-4836-94e4-ad9f7688b452 tempest-TestStampPattern-831248066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b701abf9-1b9d-4836-94e4-ad9f7688b452 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:25 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:09:25 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:25 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3d5e9ff0-37ed-4f57-977a-629cf35c04ac tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85" returned: 0 in 0.435s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3d5e9ff0-37ed-4f57-977a-629cf35c04ac tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.af8c7c25-946b-4151-9555-09f2fe84425f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:25 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.af8c7c25-946b-4151-9555-09f2fe84425f Jul 14 13:09:25 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:25 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b701abf9-1b9d-4836-94e4-ad9f7688b452 tempest-TestStampPattern-831248066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.314s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:25 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-b701abf9-1b9d-4836-94e4-ad9f7688b452 tempest-TestStampPattern-831248066 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:09:25 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b701abf9-1b9d-4836-94e4-ad9f7688b452 tempest-TestStampPattern-831248066 None] Deleted volume successfully. Jul 14 13:09:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b701abf9-1b9d-4836-94e4-ad9f7688b452 tempest-TestStampPattern-831248066 None] Lock "cinder-f94fb295-ec42-43be-9610-6e944b85c605-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:26 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3d5e9ff0-37ed-4f57-977a-629cf35c04ac tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.af8c7c25-946b-4151-9555-09f2fe84425f" returned: 0 in 0.397s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3d5e9ff0-37ed-4f57-977a-629cf35c04ac tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.af8c7c25-946b-4151-9555-09f2fe84425f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:26 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.af8c7c25-946b-4151-9555-09f2fe84425f Jul 14 13:09:26 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:26 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3d5e9ff0-37ed-4f57-977a-629cf35c04ac tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85.af8c7c25-946b-4151-9555-09f2fe84425f" returned: 0 in 0.276s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:26 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=120,cinder:UPDATE=153,cinder:DELETE=14,cinder:INSERT=53 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:09:26 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=118,cinder:UPDATE=140,cinder:INSERT=35,cinder:DELETE=12 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:09:26 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3d5e9ff0-37ed-4f57-977a-629cf35c04ac tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-quobyte-af8c7c25-946b-4151-9555-09f2fe84425f" released by "_delete_snapshot" :: held 1.691s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:26 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3d5e9ff0-37ed-4f57-977a-629cf35c04ac tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-quobyte-ec6c0024-4d49-4431-b17e-29ea8b7b5f85" released by "delete_snapshot" :: held 1.748s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:26 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-3d5e9ff0-37ed-4f57-977a-629cf35c04ac tempest-CreateVolumesFromSnapshotTest-1755036494 None] Created reservations ['39db0479-4f19-4d8d-8152-cd4a1778c2ff', 'ff58118f-3219-4c14-946e-6007faaa57fd', '34305768-5c2a-4e62-9090-469e69b4fb2c', '03519278-ec55-4c91-8861-66a9c1e5f3f3'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:09:26 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-3d5e9ff0-37ed-4f57-977a-629cf35c04ac tempest-CreateVolumesFromSnapshotTest-1755036494 None] Delete snapshot completed successfully. Jul 14 13:09:26 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3d5e9ff0-37ed-4f57-977a-629cf35c04ac tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-af8c7c25-946b-4151-9555-09f2fe84425f-delete_snapshot" released by "delete_snapshot" :: held 1.997s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:26 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e16aa324-f8ee-420f-be44-03dd240017d4 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "cinder-ec6c0024-4d49-4431-b17e-29ea8b7b5f85-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-d5d1e4d9-6cf9-4d5f-b642-4b6d262f0ff3 req-019cf7b0-a394-4099-8482-609df35b7f9b tempest-TestInstancesWithCinderVolumes-867500636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-d5d1e4d9-6cf9-4d5f-b642-4b6d262f0ff3 req-019cf7b0-a394-4099-8482-609df35b7f9b tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:26 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e16aa324-f8ee-420f-be44-03dd240017d4 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-ec6c0024-4d49-4431-b17e-29ea8b7b5f85-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:26 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad80e35-f8cc-4280-9671-3dba943b8bc2]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-d5d1e4d9-6cf9-4d5f-b642-4b6d262f0ff3 req-019cf7b0-a394-4099-8482-609df35b7f9b tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e16aa324-f8ee-420f-be44-03dd240017d4 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "cinder-quobyte-ec6c0024-4d49-4431-b17e-29ea8b7b5f85" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e16aa324-f8ee-420f-be44-03dd240017d4 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-quobyte-ec6c0024-4d49-4431-b17e-29ea8b7b5f85" acquired by "delete_volume" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7080b1-39d6-4404-aa3d-3613c445d3d1]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e16aa324-f8ee-420f-be44-03dd240017d4 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-37235e19-c240-46d0-bf99-77e00e28e2e6 tempest-TestStampPattern-831248066 None] Acquiring lock "cinder-0f3c0693-9082-427d-a43d-39d5c0e0baa4-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:27 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c Jul 14 13:09:27 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-37235e19-c240-46d0-bf99-77e00e28e2e6 tempest-TestStampPattern-831248066 None] Lock "cinder-0f3c0693-9082-427d-a43d-39d5c0e0baa4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-37235e19-c240-46d0-bf99-77e00e28e2e6 tempest-TestStampPattern-831248066 None] Acquiring lock "cinder-quobyte-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-37235e19-c240-46d0-bf99-77e00e28e2e6 tempest-TestStampPattern-831248066 None] Lock "cinder-quobyte-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-37235e19-c240-46d0-bf99-77e00e28e2e6 tempest-TestStampPattern-831248066 None] Acquiring lock "cinder-quobyte-0f3c0693-9082-427d-a43d-39d5c0e0baa4" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-37235e19-c240-46d0-bf99-77e00e28e2e6 tempest-TestStampPattern-831248066 None] Lock "cinder-quobyte-0f3c0693-9082-427d-a43d-39d5c0e0baa4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-37235e19-c240-46d0-bf99-77e00e28e2e6 tempest-TestStampPattern-831248066 None] Deleting offline snapshot 0f3c0693-9082-427d-a43d-39d5c0e0baa4 of volume 3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-37235e19-c240-46d0-bf99-77e00e28e2e6 tempest-TestStampPattern-831248066 None] snapshot_file for this snap is: volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd422f94-d6cf-42d2-9c16-ff986580c7d0]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-37235e19-c240-46d0-bf99-77e00e28e2e6 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:27 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85 Jul 14 13:09:27 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:27 devstack sudo[102185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4 Jul 14 13:09:27 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:27 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-d5d1e4d9-6cf9-4d5f-b642-4b6d262f0ff3 req-019cf7b0-a394-4099-8482-609df35b7f9b tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c" returned: 0 in 0.569s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-d5d1e4d9-6cf9-4d5f-b642-4b6d262f0ff3 req-019cf7b0-a394-4099-8482-609df35b7f9b tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:27 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e16aa324-f8ee-420f-be44-03dd240017d4 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85" returned: 0 in 0.565s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e16aa324-f8ee-420f-be44-03dd240017d4 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:27 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85 Jul 14 13:09:27 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:27 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c Jul 14 13:09:27 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:27 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-37235e19-c240-46d0-bf99-77e00e28e2e6 tempest-TestStampPattern-831248066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4" returned: 0 in 0.628s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-37235e19-c240-46d0-bf99-77e00e28e2e6 tempest-TestStampPattern-831248066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee96f6c2-d96f-44af-96c8-425a5dc27776]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-37235e19-c240-46d0-bf99-77e00e28e2e6 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:27 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:27 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e16aa324-f8ee-420f-be44-03dd240017d4 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ec6c0024-4d49-4431-b17e-29ea8b7b5f85" returned: 0 in 0.339s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-d5d1e4d9-6cf9-4d5f-b642-4b6d262f0ff3 req-019cf7b0-a394-4099-8482-609df35b7f9b tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c" returned: 1 in 0.430s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-d5d1e4d9-6cf9-4d5f-b642-4b6d262f0ff3 req-019cf7b0-a394-4099-8482-609df35b7f9b tempest-TestInstancesWithCinderVolumes-867500636 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:09:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-d5d1e4d9-6cf9-4d5f-b642-4b6d262f0ff3 req-019cf7b0-a394-4099-8482-609df35b7f9b tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.096s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e16aa324-f8ee-420f-be44-03dd240017d4 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-quobyte-ec6c0024-4d49-4431-b17e-29ea8b7b5f85" released by "delete_volume" :: held 1.008s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:28 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 Jul 14 13:09:28 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-d5d1e4d9-6cf9-4d5f-b642-4b6d262f0ff3 req-019cf7b0-a394-4099-8482-609df35b7f9b tempest-TestInstancesWithCinderVolumes-867500636 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1', 'name': 'volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8cbb2030-8670-404e-9350-4395694d6545', 'enforce_multipath': True} {{(pid=86977) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 13:09:28 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-e16aa324-f8ee-420f-be44-03dd240017d4 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Created reservations ['93c2c8d3-c23c-42af-930b-0332afda77c9', 'a2a417a6-27fd-4708-b9c8-cb0b2102bde5', 'ce65e257-b067-4f87-a07e-42d72c80c9b6', '3b241b01-8389-4e6b-a584-3eeb75d1fd65'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:09:28 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-d5d1e4d9-6cf9-4d5f-b642-4b6d262f0ff3 req-019cf7b0-a394-4099-8482-609df35b7f9b tempest-TestInstancesWithCinderVolumes-867500636 None] attachment_update completed successfully. Jul 14 13:09:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e16aa324-f8ee-420f-be44-03dd240017d4 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e16aa324-f8ee-420f-be44-03dd240017d4 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e16aa324-f8ee-420f-be44-03dd240017d4 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e16aa324-f8ee-420f-be44-03dd240017d4 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e16aa324-f8ee-420f-be44-03dd240017d4 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e16aa324-f8ee-420f-be44-03dd240017d4 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:28 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:09:28 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:28 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-37235e19-c240-46d0-bf99-77e00e28e2e6 tempest-TestStampPattern-831248066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6" returned: 0 in 0.533s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-37235e19-c240-46d0-bf99-77e00e28e2e6 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:28 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4 Jul 14 13:09:28 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:28 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e16aa324-f8ee-420f-be44-03dd240017d4 tempest-CreateVolumesFromSnapshotTest-1755036494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.333s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:28 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-e16aa324-f8ee-420f-be44-03dd240017d4 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:09:28 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e16aa324-f8ee-420f-be44-03dd240017d4 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Deleted volume successfully. Jul 14 13:09:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e16aa324-f8ee-420f-be44-03dd240017d4 tempest-CreateVolumesFromSnapshotTest-1755036494 None] Lock "cinder-ec6c0024-4d49-4431-b17e-29ea8b7b5f85-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:28 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-37235e19-c240-46d0-bf99-77e00e28e2e6 tempest-TestStampPattern-831248066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4" returned: 0 in 0.420s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-37235e19-c240-46d0-bf99-77e00e28e2e6 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:28 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4 Jul 14 13:09:28 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:29 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-37235e19-c240-46d0-bf99-77e00e28e2e6 tempest-TestStampPattern-831248066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6.0f3c0693-9082-427d-a43d-39d5c0e0baa4" returned: 0 in 0.269s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-37235e19-c240-46d0-bf99-77e00e28e2e6 tempest-TestStampPattern-831248066 None] Lock "cinder-quobyte-0f3c0693-9082-427d-a43d-39d5c0e0baa4" released by "_delete_snapshot" :: held 1.981s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-37235e19-c240-46d0-bf99-77e00e28e2e6 tempest-TestStampPattern-831248066 None] Lock "cinder-quobyte-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6" released by "delete_snapshot" :: held 2.016s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:29 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-37235e19-c240-46d0-bf99-77e00e28e2e6 tempest-TestStampPattern-831248066 None] Created reservations ['ad0722f7-1c7a-4dd0-b3c6-2e90b5bf7663', '222a1ca6-564f-45dd-bcb4-d0b0ac8b8d72', 'a380ca88-2830-498b-b041-4027dc55c202', 'cfd16fca-f36f-42fc-bfef-f67d5656fd80'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:09:29 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-37235e19-c240-46d0-bf99-77e00e28e2e6 tempest-TestStampPattern-831248066 None] Delete snapshot completed successfully. Jul 14 13:09:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-37235e19-c240-46d0-bf99-77e00e28e2e6 tempest-TestStampPattern-831248066 None] Lock "cinder-0f3c0693-9082-427d-a43d-39d5c0e0baa4-delete_snapshot" released by "delete_snapshot" :: held 2.212s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:35 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b0c6bdf1-eeda-4a04-8499-75f8c5f5d5d2 tempest-TestStampPattern-831248066 None] Acquiring lock "cinder-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:35 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b0c6bdf1-eeda-4a04-8499-75f8c5f5d5d2 tempest-TestStampPattern-831248066 None] Lock "cinder-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:35 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b0c6bdf1-eeda-4a04-8499-75f8c5f5d5d2 tempest-TestStampPattern-831248066 None] Acquiring lock "cinder-quobyte-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:35 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b0c6bdf1-eeda-4a04-8499-75f8c5f5d5d2 tempest-TestStampPattern-831248066 None] Lock "cinder-quobyte-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6" acquired by "delete_volume" :: waited 0.035s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:35 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec45daf3-530a-44b9-af20-95b605ed0b7d]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b0c6bdf1-eeda-4a04-8499-75f8c5f5d5d2 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:36 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 Jul 14 13:09:36 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:36 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b0c6bdf1-eeda-4a04-8499-75f8c5f5d5d2 tempest-TestStampPattern-831248066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6" returned: 0 in 0.620s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b0c6bdf1-eeda-4a04-8499-75f8c5f5d5d2 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:36 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6 Jul 14 13:09:36 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:37 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b0c6bdf1-eeda-4a04-8499-75f8c5f5d5d2 tempest-TestStampPattern-831248066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6" returned: 0 in 0.527s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b0c6bdf1-eeda-4a04-8499-75f8c5f5d5d2 tempest-TestStampPattern-831248066 None] Lock "cinder-quobyte-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6" released by "delete_volume" :: held 1.235s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:37 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-b0c6bdf1-eeda-4a04-8499-75f8c5f5d5d2 tempest-TestStampPattern-831248066 None] Created reservations ['857d6be1-232c-4ed6-838d-d5fc2cd54548', '060f87fe-f685-4bbd-9f84-bf4002a06f0d', '34b13822-a82e-4f93-8b51-0ed08f3f382c', '0ffaa807-ad8c-4a9f-9949-c805482fe47d'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:09:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b0c6bdf1-eeda-4a04-8499-75f8c5f5d5d2 tempest-TestStampPattern-831248066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b0c6bdf1-eeda-4a04-8499-75f8c5f5d5d2 tempest-TestStampPattern-831248066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b0c6bdf1-eeda-4a04-8499-75f8c5f5d5d2 tempest-TestStampPattern-831248066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b0c6bdf1-eeda-4a04-8499-75f8c5f5d5d2 tempest-TestStampPattern-831248066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b0c6bdf1-eeda-4a04-8499-75f8c5f5d5d2 tempest-TestStampPattern-831248066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b0c6bdf1-eeda-4a04-8499-75f8c5f5d5d2 tempest-TestStampPattern-831248066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:37 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:09:37 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:37 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b0c6bdf1-eeda-4a04-8499-75f8c5f5d5d2 tempest-TestStampPattern-831248066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.568s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:37 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-b0c6bdf1-eeda-4a04-8499-75f8c5f5d5d2 tempest-TestStampPattern-831248066 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:09:37 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b0c6bdf1-eeda-4a04-8499-75f8c5f5d5d2 tempest-TestStampPattern-831248066 None] Deleted volume successfully. Jul 14 13:09:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b0c6bdf1-eeda-4a04-8499-75f8c5f5d5d2 tempest-TestStampPattern-831248066 None] Lock "cinder-3356c9d5-99f8-4b21-aa24-0e4197d2cdb6-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:38 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:09:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Flow 'volume_create_manager' (bf903400-7b76-4f29-ac55-0878abfb9e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d7c204-f47c-4e12-9f9a-0a4f4c10caa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d7c204-f47c-4e12-9f9a-0a4f4c10caa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d24c62c-1742-4835-a5b2-4fd98d4c9572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fba9d0ce2774c638d4f80555355d4bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:38Z,use_quota=True,user_id='1ab9d2c054a44a49b4a4de6172118412',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c086d9-001e-4dce-9a23-2d745e24ca89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c086d9-001e-4dce-9a23-2d745e24ca89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8c4461-d51e-4ed6-847b-1d59f7d4e878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:38 devstack cinder-volume[86977]: DEBUG cinder.image.glance [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Creating Keystone auth plugin from conf {{(pid=86977) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 13:09:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8c4461-d51e-4ed6-847b-1d59f7d4e878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6d24c62c-1742-4835-a5b2-4fd98d4c9572', 'volume_name': 'volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572', 'volume_size': 1, 'image_id': 'cf67d398-699b-48ad-b17b-0082afbeabb4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf67d398-699b-48ad-b17b-0082afbeabb4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fd26cbb4e87e397984e48d37152ddfd8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2fba9d0ce2774c638d4f80555355d4bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '512012222379d591d31005a2718eb7e27b8899cf844191692705ba71c7550b272eb64babf29dc26744ef306e78c06ba1d97651522ddca5b2687c2b5cf333c618', 'id': 'cf67d398-699b-48ad-b17b-0082afbeabb4', 'created_at': datetime.datetime(2026, 7, 14, 11, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 11, 9, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf67d398-699b-48ad-b17b-0082afbeabb4/file', 'properties': {}}, 'image_service': }' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbfcb7a8-6321-455f-9ad8-24ac2b0fae33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbfcb7a8-6321-455f-9ad8-24ac2b0fae33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26788ba6-36f5-4f5f-8f58-648a816b59a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:38 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Volume 6d24c62c-1742-4835-a5b2-4fd98d4c9572: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572', 'volume_size': 1, 'image_id': 'cf67d398-699b-48ad-b17b-0082afbeabb4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf67d398-699b-48ad-b17b-0082afbeabb4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fd26cbb4e87e397984e48d37152ddfd8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2fba9d0ce2774c638d4f80555355d4bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '512012222379d591d31005a2718eb7e27b8899cf844191692705ba71c7550b272eb64babf29dc26744ef306e78c06ba1d97651522ddca5b2687c2b5cf333c618', 'id': 'cf67d398-699b-48ad-b17b-0082afbeabb4', 'created_at': datetime.datetime(2026, 7, 14, 11, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 11, 9, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf67d398-699b-48ad-b17b-0082afbeabb4/file', 'properties': {}}, 'image_service': } Jul 14 13:09:38 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Trying to clone 6d24c62c-1742-4835-a5b2-4fd98d4c9572 from image cf67d398-699b-48ad-b17b-0082afbeabb4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cf67d398-699b-48ad-b17b-0082afbeabb4', 'metadata': {}}]). {{(pid=86977) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 13:09:38 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:751}} Jul 14 13:09:38 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Image download 0.00 MB at 0.00 MB/s Jul 14 13:09:39 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ac6ac5-7586-45eb-9433-290cecc33838]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:39 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD Jul 14 13:09:39 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:39 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD" returned: 0 in 0.485s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:39 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD Jul 14 13:09:39 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:40 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD" returned: 1 in 0.472s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:09:40 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Temporary image cf67d398-699b-48ad-b17b-0082afbeabb4 is fetched for user 1ab9d2c054a44a49b4a4de6172118412. {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:1450}} Jul 14 13:09:40 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[940ef438-6d1c-45e9-9404-b67015fd63f5]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:40 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD Jul 14 13:09:40 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:40 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD" returned: 0 in 0.555s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:40 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD Jul 14 13:09:40 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:41 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD" returned: 1 in 0.472s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:09:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d24c62c-1742-4835-a5b2-4fd98d4c9572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fba9d0ce2774c638d4f80555355d4bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:38Z,use_quota=True,user_id='1ab9d2c054a44a49b4a4de6172118412',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:09:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Creating volume 6d24c62c-1742-4835-a5b2-4fd98d4c9572 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:09:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:09:41 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:09:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:41 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572 1073741824 Jul 14 13:09:41 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:41 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572 1073741824" returned: 0 in 0.620s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:41 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572 Jul 14 13:09:41 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:42 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572" returned: 0 in 0.410s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:42 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:09:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:42 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Attempting download of cf67d398-699b-48ad-b17b-0082afbeabb4 ((None, [{'url': 'file:///opt/stack/data/glance/images/cf67d398-699b-48ad-b17b-0082afbeabb4', 'metadata': {}}])) to volume 6d24c62c-1742-4835-a5b2-4fd98d4c9572. {{(pid=86977) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 13:09:42 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfb9818-f23c-4efc-b362-8e82f923ad40]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf67d398-699b-48ad-b17b-0082afbeabb4_kv80secm {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:42 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf67d398-699b-48ad-b17b-0082afbeabb4_kv80secm Jul 14 13:09:42 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:43 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf67d398-699b-48ad-b17b-0082afbeabb4_kv80secm" returned: 0 in 0.648s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf67d398-699b-48ad-b17b-0082afbeabb4_kv80secm {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:43 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf67d398-699b-48ad-b17b-0082afbeabb4_kv80secm Jul 14 13:09:43 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:43 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf67d398-699b-48ad-b17b-0082afbeabb4_kv80secm" returned: 1 in 0.405s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf67d398-699b-48ad-b17b-0082afbeabb4_kv80secm' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:09:43 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f1bafb-677e-4a50-94b1-15d2980761f6]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:43 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD Jul 14 13:09:43 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:43 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD" returned: 0 in 0.420s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:44 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD Jul 14 13:09:44 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:44 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD" returned: 1 in 0.372s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:09:44 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] cf67d398-699b-48ad-b17b-0082afbeabb4 was raw, converting to raw {{(pid=86977) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1139}} Jul 14 13:09:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:44 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572 Jul 14 13:09:44 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:44 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572" returned: 0 in 0.391s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:44 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cf67d398-699b-48ad-b17b-0082afbeabb4_d8ndmea6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572 {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:09:44 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Converted 0.00 MB image at 0.00 MB/s Jul 14 13:09:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:44 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572 1G Jul 14 13:09:44 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:44 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572 1G" returned: 0 in 0.304s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:45 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[480c1944-0801-4c7b-b048-1813bdef7c61]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:45 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572 Jul 14 13:09:45 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:45 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572" returned: 0 in 0.415s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:45 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572 Jul 14 13:09:45 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:45 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572" returned: 1 in 0.373s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:09:45 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Downloaded image cf67d398-699b-48ad-b17b-0082afbeabb4 ((None, [{'url': 'file:///opt/stack/data/glance/images/cf67d398-699b-48ad-b17b-0082afbeabb4', 'metadata': {}}])) to volume 6d24c62c-1742-4835-a5b2-4fd98d4c9572 successfully. {{(pid=86977) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 13:09:45 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Temporary image cf67d398-699b-48ad-b17b-0082afbeabb4 for user 1ab9d2c054a44a49b4a4de6172118412 is deleted. {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:1454}} Jul 14 13:09:45 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Marking volume 6d24c62c-1742-4835-a5b2-4fd98d4c9572 as bootable. {{(pid=86977) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 13:09:45 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Copying metadata from image cf67d398-699b-48ad-b17b-0082afbeabb4 to 6d24c62c-1742-4835-a5b2-4fd98d4c9572. {{(pid=86977) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 13:09:45 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Creating volume glance metadata for volume 6d24c62c-1742-4835-a5b2-4fd98d4c9572 backed by image cf67d398-699b-48ad-b17b-0082afbeabb4 with: {'image_id': 'cf67d398-699b-48ad-b17b-0082afbeabb4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fd26cbb4e87e397984e48d37152ddfd8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86977) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 13:09:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26788ba6-36f5-4f5f-8f58-648a816b59a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572', 'volume_size': 1, 'image_id': 'cf67d398-699b-48ad-b17b-0082afbeabb4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf67d398-699b-48ad-b17b-0082afbeabb4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fd26cbb4e87e397984e48d37152ddfd8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2fba9d0ce2774c638d4f80555355d4bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '512012222379d591d31005a2718eb7e27b8899cf844191692705ba71c7550b272eb64babf29dc26744ef306e78c06ba1d97651522ddca5b2687c2b5cf333c618', 'id': 'cf67d398-699b-48ad-b17b-0082afbeabb4', 'created_at': datetime.datetime(2026, 7, 14, 11, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 11, 9, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf67d398-699b-48ad-b17b-0082afbeabb4/file', 'properties': {}}, 'image_service': }' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb88f330-d81b-4cda-bb6f-2c3adefcd7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:45 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Volume volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572 (6d24c62c-1742-4835-a5b2-4fd98d4c9572): created successfully Jul 14 13:09:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb88f330-d81b-4cda-bb6f-2c3adefcd7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Flow 'volume_create_manager' (bf903400-7b76-4f29-ac55-0878abfb9e42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:45 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-0fc8e3a2-b273-4358-b34d-8c5a07353c69 tempest-VolumeImageDependencyTests-1945109910 None] Created volume successfully. Jul 14 13:09:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] Acquiring lock "cinder-6d24c62c-1742-4835-a5b2-4fd98d4c9572-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] Lock "cinder-6d24c62c-1742-4835-a5b2-4fd98d4c9572-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] Acquiring lock "cinder-quobyte-6d24c62c-1742-4835-a5b2-4fd98d4c9572" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] Lock "cinder-quobyte-6d24c62c-1742-4835-a5b2-4fd98d4c9572" acquired by "delete_volume" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:47 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[393cdbc1-ae1d-4c2f-8c89-64a1b43011f4]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:47 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572 Jul 14 13:09:47 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:47 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572" returned: 0 in 0.646s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:48 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572 Jul 14 13:09:48 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:48 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572" returned: 1 in 0.426s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:09:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:48 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572 Jul 14 13:09:48 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:48 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6d24c62c-1742-4835-a5b2-4fd98d4c9572" returned: 0 in 0.302s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:48 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] Lock "cinder-quobyte-6d24c62c-1742-4835-a5b2-4fd98d4c9572" released by "delete_volume" :: held 1.495s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:48 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] Created reservations ['a68ff761-0bb7-4751-84aa-8a6ec764ebb9', '3067adab-9d9c-40d8-97a9-a565c42bfce3', '7708e75d-04dc-4fec-bd33-8e8204b3b318', 'd3192323-3f59-44a1-862e-1ec6246525da'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:09:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:48 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:48 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:48 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:09:48 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:49 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.251s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:49 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:09:49 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] Deleted volume successfully. Jul 14 13:09:49 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-34fbf191-40f6-4053-924a-b289a43df23e tempest-VolumeImageDependencyTests-1945109910 None] Lock "cinder-6d24c62c-1742-4835-a5b2-4fd98d4c9572-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:51 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:09:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Flow 'volume_create_manager' (5e7dbf01-4e55-4ed4-8dc2-159214ca4d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98835bba-cc04-41a5-94e5-c1acc705eb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98835bba-cc04-41a5-94e5-c1acc705eb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-728316347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1afe28d7-6e83-436c-bc51-1c829d2b8404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400aad9f151d4321ae1153574049d6ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:52Z,use_quota=True,user_id='6bcf0751af354d9083c2b198769a58d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fbed012-69d8-4368-a0c1-ca627a6a0b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fbed012-69d8-4368-a0c1-ca627a6a0b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f84c7c-5afd-488b-8df9-d62cbfe341ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f84c7c-5afd-488b-8df9-d62cbfe341ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1afe28d7-6e83-436c-bc51-1c829d2b8404', 'volume_name': 'volume-1afe28d7-6e83-436c-bc51-1c829d2b8404', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df276481-d09f-452c-93cd-fc5265610574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df276481-d09f-452c-93cd-fc5265610574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:51 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be38ca4d-03b3-4a79-8165-bde5c84e37c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:51 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Volume 1afe28d7-6e83-436c-bc51-1c829d2b8404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1afe28d7-6e83-436c-bc51-1c829d2b8404', 'volume_size': 1} Jul 14 13:09:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-728316347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1afe28d7-6e83-436c-bc51-1c829d2b8404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400aad9f151d4321ae1153574049d6ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:52Z,use_quota=True,user_id='6bcf0751af354d9083c2b198769a58d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:09:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Creating volume 1afe28d7-6e83-436c-bc51-1c829d2b8404 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:09:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:09:51 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:09:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1afe28d7-6e83-436c-bc51-1c829d2b8404 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:51 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1afe28d7-6e83-436c-bc51-1c829d2b8404 1073741824 Jul 14 13:09:51 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:52 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1afe28d7-6e83-436c-bc51-1c829d2b8404 1073741824" returned: 0 in 0.463s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1afe28d7-6e83-436c-bc51-1c829d2b8404 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:52 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1afe28d7-6e83-436c-bc51-1c829d2b8404 Jul 14 13:09:52 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Flow 'volume_create_manager' (3932a345-6027-4e2a-8d11-7634cbe9613b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (018649df-2c93-4c59-9bdf-a5fdad777f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (018649df-2c93-4c59-9bdf-a5fdad777f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f9399a-f734-482e-bad0-d97021520cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb255e760b0444e99cc0e01f77ac533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:52Z,use_quota=True,user_id='bd8e42dee2c9443cb1a9e56c34835a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c14179-f8ef-4e7c-a545-01f923a7bd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c14179-f8ef-4e7c-a545-01f923a7bd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d4d3b8-6fd8-4f20-9c17-09d8ea884e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d4d3b8-6fd8-4f20-9c17-09d8ea884e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9f9399a-f734-482e-bad0-d97021520cd6', 'volume_name': 'volume-a9f9399a-f734-482e-bad0-d97021520cd6', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7b5f08-fc35-424f-a200-173fbca48f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7b5f08-fc35-424f-a200-173fbca48f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e088fa-fcd8-4ae3-8888-0d850123d762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:52 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Volume a9f9399a-f734-482e-bad0-d97021520cd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9f9399a-f734-482e-bad0-d97021520cd6', 'volume_size': 1} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:52 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1afe28d7-6e83-436c-bc51-1c829d2b8404" returned: 0 in 0.245s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.126s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f9399a-f734-482e-bad0-d97021520cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb255e760b0444e99cc0e01f77ac533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:52Z,use_quota=True,user_id='bd8e42dee2c9443cb1a9e56c34835a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Creating volume a9f9399a-f734-482e-bad0-d97021520cd6 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:09:52 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a9f9399a-f734-482e-bad0-d97021520cd6 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be38ca4d-03b3-4a79-8165-bde5c84e37c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1afe28d7-6e83-436c-bc51-1c829d2b8404', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b1c235-cb4e-4397-a979-a5918595e852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:52 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a9f9399a-f734-482e-bad0-d97021520cd6 1073741824 Jul 14 13:09:52 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:52 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Volume volume-1afe28d7-6e83-436c-bc51-1c829d2b8404 (1afe28d7-6e83-436c-bc51-1c829d2b8404): created successfully Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b1c235-cb4e-4397-a979-a5918595e852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:52 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Flow 'volume_create_manager' (5e7dbf01-4e55-4ed4-8dc2-159214ca4d41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:52 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-ab988662-ea88-47f3-91d7-21d827475bfc tempest-ProjectReaderTests-1889354343 None] Created volume successfully. Jul 14 13:09:53 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a9f9399a-f734-482e-bad0-d97021520cd6 1073741824" returned: 0 in 0.424s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a9f9399a-f734-482e-bad0-d97021520cd6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:53 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a9f9399a-f734-482e-bad0-d97021520cd6 Jul 14 13:09:53 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:53 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a9f9399a-f734-482e-bad0-d97021520cd6" returned: 0 in 0.235s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:53 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:09:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e088fa-fcd8-4ae3-8888-0d850123d762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9f9399a-f734-482e-bad0-d97021520cd6', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7badda6e-04d7-4a40-8f2d-b6b1873ce646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:53 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Volume volume-a9f9399a-f734-482e-bad0-d97021520cd6 (a9f9399a-f734-482e-bad0-d97021520cd6): created successfully Jul 14 13:09:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7badda6e-04d7-4a40-8f2d-b6b1873ce646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Flow 'volume_create_manager' (3932a345-6027-4e2a-8d11-7634cbe9613b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:53 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-8372693f-2aa7-4fe7-8acc-dfbbecc434c0 tempest-CinderUnicodeTest-401924484 None] Created volume successfully. Jul 14 13:09:54 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ab52b626-3b42-4d09-82fc-aafa1fd67b93 tempest-ProjectReaderTests-1889354343 None] Acquiring lock "cinder-1afe28d7-6e83-436c-bc51-1c829d2b8404-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:54 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ab52b626-3b42-4d09-82fc-aafa1fd67b93 tempest-ProjectReaderTests-1889354343 None] Lock "cinder-1afe28d7-6e83-436c-bc51-1c829d2b8404-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:54 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ab52b626-3b42-4d09-82fc-aafa1fd67b93 tempest-ProjectReaderTests-1889354343 None] Acquiring lock "cinder-quobyte-1afe28d7-6e83-436c-bc51-1c829d2b8404" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:54 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ab52b626-3b42-4d09-82fc-aafa1fd67b93 tempest-ProjectReaderTests-1889354343 None] Lock "cinder-quobyte-1afe28d7-6e83-436c-bc51-1c829d2b8404" acquired by "delete_volume" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:54 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[176e5c67-919a-4327-903b-90bc4fcfd47a]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ab52b626-3b42-4d09-82fc-aafa1fd67b93 tempest-ProjectReaderTests-1889354343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1afe28d7-6e83-436c-bc51-1c829d2b8404 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:54 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1afe28d7-6e83-436c-bc51-1c829d2b8404 Jul 14 13:09:54 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:54 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ab52b626-3b42-4d09-82fc-aafa1fd67b93 tempest-ProjectReaderTests-1889354343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1afe28d7-6e83-436c-bc51-1c829d2b8404" returned: 0 in 0.369s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ab52b626-3b42-4d09-82fc-aafa1fd67b93 tempest-ProjectReaderTests-1889354343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1afe28d7-6e83-436c-bc51-1c829d2b8404 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:54 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1afe28d7-6e83-436c-bc51-1c829d2b8404 Jul 14 13:09:54 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:54 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ab52b626-3b42-4d09-82fc-aafa1fd67b93 tempest-ProjectReaderTests-1889354343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1afe28d7-6e83-436c-bc51-1c829d2b8404" returned: 0 in 0.246s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:54 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ab52b626-3b42-4d09-82fc-aafa1fd67b93 tempest-ProjectReaderTests-1889354343 None] Lock "cinder-quobyte-1afe28d7-6e83-436c-bc51-1c829d2b8404" released by "delete_volume" :: held 0.660s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:54 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-ab52b626-3b42-4d09-82fc-aafa1fd67b93 tempest-ProjectReaderTests-1889354343 None] Created reservations ['ea506272-2b54-4825-9aaf-78ec3c249267', '6a71b714-c677-45ed-a0d5-b43b84f45444', 'e6a0e5d4-ed34-4e13-92ff-b292c506a15f', 'e738f2b1-6328-4809-b532-5d8d445c782b'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:09:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ab52b626-3b42-4d09-82fc-aafa1fd67b93 tempest-ProjectReaderTests-1889354343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ab52b626-3b42-4d09-82fc-aafa1fd67b93 tempest-ProjectReaderTests-1889354343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:54 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ab52b626-3b42-4d09-82fc-aafa1fd67b93 tempest-ProjectReaderTests-1889354343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:54 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ab52b626-3b42-4d09-82fc-aafa1fd67b93 tempest-ProjectReaderTests-1889354343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ab52b626-3b42-4d09-82fc-aafa1fd67b93 tempest-ProjectReaderTests-1889354343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ab52b626-3b42-4d09-82fc-aafa1fd67b93 tempest-ProjectReaderTests-1889354343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:55 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:09:55 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Flow 'volume_create_manager' (2d884128-ed68-4d10-9d1f-9ca717c19c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (201af8be-59e6-4050-ab6e-89b8c8586d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (201af8be-59e6-4050-ab6e-89b8c8586d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1603391302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2218dac-c6bc-447c-ad4f-e06a704e6a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb255e760b0444e99cc0e01f77ac533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:55Z,use_quota=True,user_id='bd8e42dee2c9443cb1a9e56c34835a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7466264d-6c91-4bf2-b6c2-37e612332168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7466264d-6c91-4bf2-b6c2-37e612332168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82fe3112-a906-4ae2-a831-901b0c904c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82fe3112-a906-4ae2-a831-901b0c904c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2218dac-c6bc-447c-ad4f-e06a704e6a52', 'volume_name': 'volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef9a9e1-c2dd-4448-844d-3c8e1ae2659d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef9a9e1-c2dd-4448-844d-3c8e1ae2659d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fde138d-5392-443d-a13e-b711b5254ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:55 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Volume b2218dac-c6bc-447c-ad4f-e06a704e6a52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52', 'volume_size': 1} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1603391302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2218dac-c6bc-447c-ad4f-e06a704e6a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb255e760b0444e99cc0e01f77ac533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:55Z,use_quota=True,user_id='bd8e42dee2c9443cb1a9e56c34835a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Creating volume b2218dac-c6bc-447c-ad4f-e06a704e6a52 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:09:55 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:55 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52 1073741824 Jul 14 13:09:55 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:55 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ab52b626-3b42-4d09-82fc-aafa1fd67b93 tempest-ProjectReaderTests-1889354343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.294s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-ab52b626-3b42-4d09-82fc-aafa1fd67b93 tempest-ProjectReaderTests-1889354343 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:09:55 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-ab52b626-3b42-4d09-82fc-aafa1fd67b93 tempest-ProjectReaderTests-1889354343 None] Deleted volume successfully. Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ab52b626-3b42-4d09-82fc-aafa1fd67b93 tempest-ProjectReaderTests-1889354343 None] Lock "cinder-1afe28d7-6e83-436c-bc51-1c829d2b8404-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:55 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52 1073741824" returned: 0 in 0.626s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Flow 'volume_create_manager' (11823e2c-619e-44e9-80bc-be0901c8a0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88dd0669-f083-4f9c-bbeb-08764168fe66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88dd0669-f083-4f9c-bbeb-08764168fe66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-246133800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae64abb2-15fa-4248-8a11-35b6b7113a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400aad9f151d4321ae1153574049d6ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:56Z,use_quota=True,user_id='6bcf0751af354d9083c2b198769a58d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f10374-dbc9-4517-9d75-f8c1b1016c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f10374-dbc9-4517-9d75-f8c1b1016c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc31f693-8591-42a3-89b8-3309d8beed22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc31f693-8591-42a3-89b8-3309d8beed22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae64abb2-15fa-4248-8a11-35b6b7113a80', 'volume_name': 'volume-ae64abb2-15fa-4248-8a11-35b6b7113a80', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10393d4-896c-4e71-8fab-20ba339ec62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10393d4-896c-4e71-8fab-20ba339ec62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb4e7695-3c41-4840-a8dc-b132b1b7946e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:55 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Volume ae64abb2-15fa-4248-8a11-35b6b7113a80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae64abb2-15fa-4248-8a11-35b6b7113a80', 'volume_size': 1} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:55 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52 Jul 14 13:09:55 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:56 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52" returned: 0 in 0.262s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.269s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-246133800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae64abb2-15fa-4248-8a11-35b6b7113a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400aad9f151d4321ae1153574049d6ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:09:56Z,use_quota=True,user_id='6bcf0751af354d9083c2b198769a58d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Creating volume ae64abb2-15fa-4248-8a11-35b6b7113a80 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:09:56 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ae64abb2-15fa-4248-8a11-35b6b7113a80 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fde138d-5392-443d-a13e-b711b5254ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:56 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ae64abb2-15fa-4248-8a11-35b6b7113a80 1073741824 Jul 14 13:09:56 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392978b4-eee9-4d58-8494-dcfaa3a3c240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:56 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Volume volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52 (b2218dac-c6bc-447c-ad4f-e06a704e6a52): created successfully Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392978b4-eee9-4d58-8494-dcfaa3a3c240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Flow 'volume_create_manager' (2d884128-ed68-4d10-9d1f-9ca717c19c57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:56 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-41875b36-a72f-4d11-8768-8a701b1383b1 tempest-CinderUnicodeTest-401924484 None] Created volume successfully. Jul 14 13:09:56 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ae64abb2-15fa-4248-8a11-35b6b7113a80 1073741824" returned: 0 in 0.429s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ae64abb2-15fa-4248-8a11-35b6b7113a80 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:56 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ae64abb2-15fa-4248-8a11-35b6b7113a80 Jul 14 13:09:56 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:56 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ae64abb2-15fa-4248-8a11-35b6b7113a80" returned: 0 in 0.266s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb4e7695-3c41-4840-a8dc-b132b1b7946e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae64abb2-15fa-4248-8a11-35b6b7113a80', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f3dba1-4e89-4220-82e3-64ee5a8a9dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:09:56 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Volume volume-ae64abb2-15fa-4248-8a11-35b6b7113a80 (ae64abb2-15fa-4248-8a11-35b6b7113a80): created successfully Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f3dba1-4e89-4220-82e3-64ee5a8a9dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:09:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Flow 'volume_create_manager' (11823e2c-619e-44e9-80bc-be0901c8a0a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:09:57 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-4c7e274c-1538-4953-ae80-1e995082e232 tempest-ProjectReaderTests-1889354343 None] Created volume successfully. Jul 14 13:09:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ecfe246f-f188-4aba-9dcd-2692a9c16765 tempest-CinderUnicodeTest-401924484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ecfe246f-f188-4aba-9dcd-2692a9c16765 tempest-CinderUnicodeTest-401924484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-ecfe246f-f188-4aba-9dcd-2692a9c16765 tempest-CinderUnicodeTest-401924484 None] Creating offline snapshot 43dc82bd-401b-43a3-9af8-8612222c6437 of volume b2218dac-c6bc-447c-ad4f-e06a704e6a52 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:09:57 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff418d26-b4e2-43ff-9f6d-e51a31b4f600]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ecfe246f-f188-4aba-9dcd-2692a9c16765 tempest-CinderUnicodeTest-401924484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:57 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52 Jul 14 13:09:57 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:57 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ecfe246f-f188-4aba-9dcd-2692a9c16765 tempest-CinderUnicodeTest-401924484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52" returned: 0 in 0.421s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ecfe246f-f188-4aba-9dcd-2692a9c16765 tempest-CinderUnicodeTest-401924484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.43dc82bd-401b-43a3-9af8-8612222c6437 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:57 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.43dc82bd-401b-43a3-9af8-8612222c6437 1G Jul 14 13:09:57 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:57 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4a28cc6a-644e-4c3d-b773-52f38893b364 tempest-ProjectReaderTests-1889354343 None] Acquiring lock "cinder-ae64abb2-15fa-4248-8a11-35b6b7113a80-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:57 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4a28cc6a-644e-4c3d-b773-52f38893b364 tempest-ProjectReaderTests-1889354343 None] Lock "cinder-ae64abb2-15fa-4248-8a11-35b6b7113a80-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4a28cc6a-644e-4c3d-b773-52f38893b364 tempest-ProjectReaderTests-1889354343 None] Acquiring lock "cinder-quobyte-ae64abb2-15fa-4248-8a11-35b6b7113a80" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:09:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4a28cc6a-644e-4c3d-b773-52f38893b364 tempest-ProjectReaderTests-1889354343 None] Lock "cinder-quobyte-ae64abb2-15fa-4248-8a11-35b6b7113a80" acquired by "delete_volume" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:09:58 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[865de746-79c7-4426-b9f1-6c222f1d325e]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:09:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4a28cc6a-644e-4c3d-b773-52f38893b364 tempest-ProjectReaderTests-1889354343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ae64abb2-15fa-4248-8a11-35b6b7113a80 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:58 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ae64abb2-15fa-4248-8a11-35b6b7113a80 Jul 14 13:09:58 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:58 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ecfe246f-f188-4aba-9dcd-2692a9c16765 tempest-CinderUnicodeTest-401924484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.43dc82bd-401b-43a3-9af8-8612222c6437 1G" returned: 0 in 0.459s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ecfe246f-f188-4aba-9dcd-2692a9c16765 tempest-CinderUnicodeTest-401924484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.43dc82bd-401b-43a3-9af8-8612222c6437 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:58 devstack sudo[102941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.43dc82bd-401b-43a3-9af8-8612222c6437 Jul 14 13:09:58 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:58 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4a28cc6a-644e-4c3d-b773-52f38893b364 tempest-ProjectReaderTests-1889354343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ae64abb2-15fa-4248-8a11-35b6b7113a80" returned: 0 in 0.386s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4a28cc6a-644e-4c3d-b773-52f38893b364 tempest-ProjectReaderTests-1889354343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ae64abb2-15fa-4248-8a11-35b6b7113a80 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:58 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ae64abb2-15fa-4248-8a11-35b6b7113a80 Jul 14 13:09:58 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:58 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ecfe246f-f188-4aba-9dcd-2692a9c16765 tempest-CinderUnicodeTest-401924484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.43dc82bd-401b-43a3-9af8-8612222c6437" returned: 0 in 0.326s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:58 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-ecfe246f-f188-4aba-9dcd-2692a9c16765 tempest-CinderUnicodeTest-401924484 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.43dc82bd-401b-43a3-9af8-8612222c6437 is being set with open permissions: ugo+rw Jul 14 13:09:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ecfe246f-f188-4aba-9dcd-2692a9c16765 tempest-CinderUnicodeTest-401924484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.43dc82bd-401b-43a3-9af8-8612222c6437 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:58 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.43dc82bd-401b-43a3-9af8-8612222c6437 Jul 14 13:09:58 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:58 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4a28cc6a-644e-4c3d-b773-52f38893b364 tempest-ProjectReaderTests-1889354343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-ae64abb2-15fa-4248-8a11-35b6b7113a80" returned: 0 in 0.258s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4a28cc6a-644e-4c3d-b773-52f38893b364 tempest-ProjectReaderTests-1889354343 None] Lock "cinder-quobyte-ae64abb2-15fa-4248-8a11-35b6b7113a80" released by "delete_volume" :: held 0.688s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:58 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-4a28cc6a-644e-4c3d-b773-52f38893b364 tempest-ProjectReaderTests-1889354343 None] Created reservations ['099f1d21-3d45-4ebb-9d02-487fbaac801c', '0a9dc1cf-2b94-41dc-8c75-778a5321ea49', 'e6e98081-8ea6-4e13-bcc4-57835b4575e1', 'dbe1c18b-178e-482b-8549-833a005178c9'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:09:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4a28cc6a-644e-4c3d-b773-52f38893b364 tempest-ProjectReaderTests-1889354343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:09:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4a28cc6a-644e-4c3d-b773-52f38893b364 tempest-ProjectReaderTests-1889354343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:09:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4a28cc6a-644e-4c3d-b773-52f38893b364 tempest-ProjectReaderTests-1889354343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:09:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4a28cc6a-644e-4c3d-b773-52f38893b364 tempest-ProjectReaderTests-1889354343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:09:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4a28cc6a-644e-4c3d-b773-52f38893b364 tempest-ProjectReaderTests-1889354343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4a28cc6a-644e-4c3d-b773-52f38893b364 tempest-ProjectReaderTests-1889354343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:58 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:58 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:09:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ecfe246f-f188-4aba-9dcd-2692a9c16765 tempest-CinderUnicodeTest-401924484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.43dc82bd-401b-43a3-9af8-8612222c6437" returned: 0 in 0.259s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:58 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ecfe246f-f188-4aba-9dcd-2692a9c16765 tempest-CinderUnicodeTest-401924484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:58 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.info Jul 14 13:09:58 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:59 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4a28cc6a-644e-4c3d-b773-52f38893b364 tempest-ProjectReaderTests-1889354343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.268s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:59 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-4a28cc6a-644e-4c3d-b773-52f38893b364 tempest-ProjectReaderTests-1889354343 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:09:59 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-4a28cc6a-644e-4c3d-b773-52f38893b364 tempest-ProjectReaderTests-1889354343 None] Deleted volume successfully. Jul 14 13:09:59 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4a28cc6a-644e-4c3d-b773-52f38893b364 tempest-ProjectReaderTests-1889354343 None] Lock "cinder-ae64abb2-15fa-4248-8a11-35b6b7113a80-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:09:59 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ecfe246f-f188-4aba-9dcd-2692a9c16765 tempest-CinderUnicodeTest-401924484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.info" returned: 0 in 0.275s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:59 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-ecfe246f-f188-4aba-9dcd-2692a9c16765 tempest-CinderUnicodeTest-401924484 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.info is being set with open permissions: ugo+rw Jul 14 13:09:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ecfe246f-f188-4aba-9dcd-2692a9c16765 tempest-CinderUnicodeTest-401924484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:09:59 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.info Jul 14 13:09:59 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:09:59 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Jul 14 13:09:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ecfe246f-f188-4aba-9dcd-2692a9c16765 tempest-CinderUnicodeTest-401924484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.info" returned: 0 in 0.249s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:09:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ecfe246f-f188-4aba-9dcd-2692a9c16765 tempest-CinderUnicodeTest-401924484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.082s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:09:59 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-ecfe246f-f188-4aba-9dcd-2692a9c16765 tempest-CinderUnicodeTest-401924484 None] Create snapshot completed successfully Jul 14 13:10:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6480c3b4-053c-40ea-af8f-d4082100b34c tempest-CinderUnicodeTest-401924484 None] Acquiring lock "cinder-43dc82bd-401b-43a3-9af8-8612222c6437-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:10:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6480c3b4-053c-40ea-af8f-d4082100b34c tempest-CinderUnicodeTest-401924484 None] Lock "cinder-43dc82bd-401b-43a3-9af8-8612222c6437-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:10:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6480c3b4-053c-40ea-af8f-d4082100b34c tempest-CinderUnicodeTest-401924484 None] Acquiring lock "cinder-quobyte-b2218dac-c6bc-447c-ad4f-e06a704e6a52" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:10:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6480c3b4-053c-40ea-af8f-d4082100b34c tempest-CinderUnicodeTest-401924484 None] Lock "cinder-quobyte-b2218dac-c6bc-447c-ad4f-e06a704e6a52" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:10:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6480c3b4-053c-40ea-af8f-d4082100b34c tempest-CinderUnicodeTest-401924484 None] Acquiring lock "cinder-quobyte-43dc82bd-401b-43a3-9af8-8612222c6437" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:10:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6480c3b4-053c-40ea-af8f-d4082100b34c tempest-CinderUnicodeTest-401924484 None] Lock "cinder-quobyte-43dc82bd-401b-43a3-9af8-8612222c6437" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:10:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-6480c3b4-053c-40ea-af8f-d4082100b34c tempest-CinderUnicodeTest-401924484 None] Deleting offline snapshot 43dc82bd-401b-43a3-9af8-8612222c6437 of volume b2218dac-c6bc-447c-ad4f-e06a704e6a52 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:10:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-6480c3b4-053c-40ea-af8f-d4082100b34c tempest-CinderUnicodeTest-401924484 None] snapshot_file for this snap is: volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.43dc82bd-401b-43a3-9af8-8612222c6437 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:10:00 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e5a250-b6dd-418c-9383-c1cc33195bb8]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:10:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6480c3b4-053c-40ea-af8f-d4082100b34c tempest-CinderUnicodeTest-401924484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.43dc82bd-401b-43a3-9af8-8612222c6437 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:00 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.43dc82bd-401b-43a3-9af8-8612222c6437 Jul 14 13:10:00 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:01 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6480c3b4-053c-40ea-af8f-d4082100b34c tempest-CinderUnicodeTest-401924484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.43dc82bd-401b-43a3-9af8-8612222c6437" returned: 0 in 0.393s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-6480c3b4-053c-40ea-af8f-d4082100b34c tempest-CinderUnicodeTest-401924484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:10:01 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce0c000-179f-48e8-bab6-8ab768d360a3]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:10:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6480c3b4-053c-40ea-af8f-d4082100b34c tempest-CinderUnicodeTest-401924484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:01 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52 Jul 14 13:10:01 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:01 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6480c3b4-053c-40ea-af8f-d4082100b34c tempest-CinderUnicodeTest-401924484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52" returned: 0 in 0.372s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6480c3b4-053c-40ea-af8f-d4082100b34c tempest-CinderUnicodeTest-401924484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.43dc82bd-401b-43a3-9af8-8612222c6437 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:01 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.43dc82bd-401b-43a3-9af8-8612222c6437 Jul 14 13:10:01 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:01 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6480c3b4-053c-40ea-af8f-d4082100b34c tempest-CinderUnicodeTest-401924484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.43dc82bd-401b-43a3-9af8-8612222c6437" returned: 0 in 0.367s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6480c3b4-053c-40ea-af8f-d4082100b34c tempest-CinderUnicodeTest-401924484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.43dc82bd-401b-43a3-9af8-8612222c6437 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:01 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.43dc82bd-401b-43a3-9af8-8612222c6437 Jul 14 13:10:01 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:02 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6480c3b4-053c-40ea-af8f-d4082100b34c tempest-CinderUnicodeTest-401924484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52.43dc82bd-401b-43a3-9af8-8612222c6437" returned: 0 in 0.281s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6480c3b4-053c-40ea-af8f-d4082100b34c tempest-CinderUnicodeTest-401924484 None] Lock "cinder-quobyte-43dc82bd-401b-43a3-9af8-8612222c6437" released by "_delete_snapshot" :: held 1.539s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:10:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6480c3b4-053c-40ea-af8f-d4082100b34c tempest-CinderUnicodeTest-401924484 None] Lock "cinder-quobyte-b2218dac-c6bc-447c-ad4f-e06a704e6a52" released by "delete_snapshot" :: held 1.562s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:10:02 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-6480c3b4-053c-40ea-af8f-d4082100b34c tempest-CinderUnicodeTest-401924484 None] Created reservations ['883dc222-dd71-4df4-80b2-6212e4bdf5f1', '7b64d388-5418-478c-8e76-260638f21c8f', '9755236f-a6de-48f3-81bd-c86d21533ec3', '2a31a304-b247-48a7-9695-0ce58427d79d'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:10:02 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-6480c3b4-053c-40ea-af8f-d4082100b34c tempest-CinderUnicodeTest-401924484 None] Delete snapshot completed successfully. Jul 14 13:10:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6480c3b4-053c-40ea-af8f-d4082100b34c tempest-CinderUnicodeTest-401924484 None] Lock "cinder-43dc82bd-401b-43a3-9af8-8612222c6437-delete_snapshot" released by "delete_snapshot" :: held 1.752s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:10:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-e2cd9707-f712-4df6-9bf0-46b843d6e99f req-3acd5764-3fc1-46b8-ab60-075acd088980 tempest-TestInstancesWithCinderVolumes-867500636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:10:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-e2cd9707-f712-4df6-9bf0-46b843d6e99f req-3acd5764-3fc1-46b8-ab60-075acd088980 tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:10:02 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[409af8ba-531b-4daf-b8e3-bb1c418e406a]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:10:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-e2cd9707-f712-4df6-9bf0-46b843d6e99f req-3acd5764-3fc1-46b8-ab60-075acd088980 tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a88438b3-31d9-41b8-8b8a-1ae7977c50b8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c9dc5835-7ff3-4101-9242-10511be32586 tempest-CinderUnicodeTest-401924484 None] Acquiring lock "cinder-b2218dac-c6bc-447c-ad4f-e06a704e6a52-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:10:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c9dc5835-7ff3-4101-9242-10511be32586 tempest-CinderUnicodeTest-401924484 None] Lock "cinder-b2218dac-c6bc-447c-ad4f-e06a704e6a52-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:10:02 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a88438b3-31d9-41b8-8b8a-1ae7977c50b8 Jul 14 13:10:02 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c9dc5835-7ff3-4101-9242-10511be32586 tempest-CinderUnicodeTest-401924484 None] Acquiring lock "cinder-quobyte-b2218dac-c6bc-447c-ad4f-e06a704e6a52" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:10:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c9dc5835-7ff3-4101-9242-10511be32586 tempest-CinderUnicodeTest-401924484 None] Lock "cinder-quobyte-b2218dac-c6bc-447c-ad4f-e06a704e6a52" acquired by "delete_volume" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:10:02 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a9b8fe-74bd-4214-8f7c-7d03daba8baa]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:10:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c9dc5835-7ff3-4101-9242-10511be32586 tempest-CinderUnicodeTest-401924484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:03 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52 Jul 14 13:10:03 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:03 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-e2cd9707-f712-4df6-9bf0-46b843d6e99f req-3acd5764-3fc1-46b8-ab60-075acd088980 tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a88438b3-31d9-41b8-8b8a-1ae7977c50b8" returned: 0 in 0.436s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-e2cd9707-f712-4df6-9bf0-46b843d6e99f req-3acd5764-3fc1-46b8-ab60-075acd088980 tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.468s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:10:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-e2cd9707-f712-4df6-9bf0-46b843d6e99f req-3acd5764-3fc1-46b8-ab60-075acd088980 tempest-TestInstancesWithCinderVolumes-867500636 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1', 'name': 'volume-a88438b3-31d9-41b8-8b8a-1ae7977c50b8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32c4deb0-4fdc-4bc5-920d-ceb7bd6ff3e0', 'enforce_multipath': True} {{(pid=86977) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 13:10:03 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-e2cd9707-f712-4df6-9bf0-46b843d6e99f req-3acd5764-3fc1-46b8-ab60-075acd088980 tempest-TestInstancesWithCinderVolumes-867500636 None] attachment_update completed successfully. Jul 14 13:10:03 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c9dc5835-7ff3-4101-9242-10511be32586 tempest-CinderUnicodeTest-401924484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52" returned: 0 in 0.421s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c9dc5835-7ff3-4101-9242-10511be32586 tempest-CinderUnicodeTest-401924484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:03 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52 Jul 14 13:10:03 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:03 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c9dc5835-7ff3-4101-9242-10511be32586 tempest-CinderUnicodeTest-401924484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b2218dac-c6bc-447c-ad4f-e06a704e6a52" returned: 0 in 0.326s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c9dc5835-7ff3-4101-9242-10511be32586 tempest-CinderUnicodeTest-401924484 None] Lock "cinder-quobyte-b2218dac-c6bc-447c-ad4f-e06a704e6a52" released by "delete_volume" :: held 0.828s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:10:03 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-c9dc5835-7ff3-4101-9242-10511be32586 tempest-CinderUnicodeTest-401924484 None] Created reservations ['18368261-505b-4bcd-92be-022bf0c4276b', 'fad71186-6493-4f60-9b17-0a13143846f0', 'cbe2f4e0-eabd-4c3d-92c2-baadc45bdc7e', 'ff7c8183-b3ce-431d-963f-7651a406182f'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:10:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c9dc5835-7ff3-4101-9242-10511be32586 tempest-CinderUnicodeTest-401924484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:10:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c9dc5835-7ff3-4101-9242-10511be32586 tempest-CinderUnicodeTest-401924484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:10:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c9dc5835-7ff3-4101-9242-10511be32586 tempest-CinderUnicodeTest-401924484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:10:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c9dc5835-7ff3-4101-9242-10511be32586 tempest-CinderUnicodeTest-401924484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:10:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c9dc5835-7ff3-4101-9242-10511be32586 tempest-CinderUnicodeTest-401924484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:10:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c9dc5835-7ff3-4101-9242-10511be32586 tempest-CinderUnicodeTest-401924484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:03 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:10:03 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:04 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0b8db066-80bd-4175-976c-eebbe2fe49b0 tempest-CinderUnicodeTest-401924484 None] Acquiring lock "cinder-a9f9399a-f734-482e-bad0-d97021520cd6-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:10:04 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0b8db066-80bd-4175-976c-eebbe2fe49b0 tempest-CinderUnicodeTest-401924484 None] Lock "cinder-a9f9399a-f734-482e-bad0-d97021520cd6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:10:04 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0b8db066-80bd-4175-976c-eebbe2fe49b0 tempest-CinderUnicodeTest-401924484 None] Acquiring lock "cinder-quobyte-a9f9399a-f734-482e-bad0-d97021520cd6" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:10:04 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0b8db066-80bd-4175-976c-eebbe2fe49b0 tempest-CinderUnicodeTest-401924484 None] Lock "cinder-quobyte-a9f9399a-f734-482e-bad0-d97021520cd6" acquired by "delete_volume" :: waited 0.014s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:10:04 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[4193ada4-39ff-4d01-bc92-d50106d012c0]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:10:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0b8db066-80bd-4175-976c-eebbe2fe49b0 tempest-CinderUnicodeTest-401924484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a9f9399a-f734-482e-bad0-d97021520cd6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:04 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c9dc5835-7ff3-4101-9242-10511be32586 tempest-CinderUnicodeTest-401924484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.290s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:04 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-c9dc5835-7ff3-4101-9242-10511be32586 tempest-CinderUnicodeTest-401924484 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:10:04 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c9dc5835-7ff3-4101-9242-10511be32586 tempest-CinderUnicodeTest-401924484 None] Deleted volume successfully. Jul 14 13:10:04 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c9dc5835-7ff3-4101-9242-10511be32586 tempest-CinderUnicodeTest-401924484 None] Lock "cinder-b2218dac-c6bc-447c-ad4f-e06a704e6a52-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:10:04 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a9f9399a-f734-482e-bad0-d97021520cd6 Jul 14 13:10:04 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:04 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0b8db066-80bd-4175-976c-eebbe2fe49b0 tempest-CinderUnicodeTest-401924484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a9f9399a-f734-482e-bad0-d97021520cd6" returned: 0 in 0.402s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0b8db066-80bd-4175-976c-eebbe2fe49b0 tempest-CinderUnicodeTest-401924484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a9f9399a-f734-482e-bad0-d97021520cd6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:04 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a9f9399a-f734-482e-bad0-d97021520cd6 Jul 14 13:10:04 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:04 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0b8db066-80bd-4175-976c-eebbe2fe49b0 tempest-CinderUnicodeTest-401924484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a9f9399a-f734-482e-bad0-d97021520cd6" returned: 0 in 0.280s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:04 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0b8db066-80bd-4175-976c-eebbe2fe49b0 tempest-CinderUnicodeTest-401924484 None] Lock "cinder-quobyte-a9f9399a-f734-482e-bad0-d97021520cd6" released by "delete_volume" :: held 0.746s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:10:04 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-0b8db066-80bd-4175-976c-eebbe2fe49b0 tempest-CinderUnicodeTest-401924484 None] Created reservations ['620eed26-dced-446c-833f-f8431a096cf8', '047a27e7-0926-4290-bf26-5769d2d75728', 'bf867855-386e-4a71-8a90-39bad1be581e', '5d1baea3-2afa-4d46-b467-651182ce466b'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:10:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0b8db066-80bd-4175-976c-eebbe2fe49b0 tempest-CinderUnicodeTest-401924484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:10:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0b8db066-80bd-4175-976c-eebbe2fe49b0 tempest-CinderUnicodeTest-401924484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:10:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0b8db066-80bd-4175-976c-eebbe2fe49b0 tempest-CinderUnicodeTest-401924484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:10:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0b8db066-80bd-4175-976c-eebbe2fe49b0 tempest-CinderUnicodeTest-401924484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:10:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0b8db066-80bd-4175-976c-eebbe2fe49b0 tempest-CinderUnicodeTest-401924484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:10:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0b8db066-80bd-4175-976c-eebbe2fe49b0 tempest-CinderUnicodeTest-401924484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:05 devstack sudo[103032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:10:05 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:05 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0b8db066-80bd-4175-976c-eebbe2fe49b0 tempest-CinderUnicodeTest-401924484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.304s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:05 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-0b8db066-80bd-4175-976c-eebbe2fe49b0 tempest-CinderUnicodeTest-401924484 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:10:05 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-0b8db066-80bd-4175-976c-eebbe2fe49b0 tempest-CinderUnicodeTest-401924484 None] Deleted volume successfully. Jul 14 13:10:05 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0b8db066-80bd-4175-976c-eebbe2fe49b0 tempest-CinderUnicodeTest-401924484 None] Lock "cinder-a9f9399a-f734-482e-bad0-d97021520cd6-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:10:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-5279e889-e1ee-4ede-ab95-16862f99e7b2 req-a87fdd9c-5932-4642-8c61-bc95b5e7ea29 tempest-TestInstancesWithCinderVolumes-867500636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:10:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-5279e889-e1ee-4ede-ab95-16862f99e7b2 req-a87fdd9c-5932-4642-8c61-bc95b5e7ea29 tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:10:06 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdce8947-83b4-4013-b24f-fe37f97962b3]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:10:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-5279e889-e1ee-4ede-ab95-16862f99e7b2 req-a87fdd9c-5932-4642-8c61-bc95b5e7ea29 tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-414a408e-7cce-4788-895d-d6b21a8301e4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:06 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-414a408e-7cce-4788-895d-d6b21a8301e4 Jul 14 13:10:06 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:06 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-5279e889-e1ee-4ede-ab95-16862f99e7b2 req-a87fdd9c-5932-4642-8c61-bc95b5e7ea29 tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-414a408e-7cce-4788-895d-d6b21a8301e4" returned: 0 in 0.491s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-5279e889-e1ee-4ede-ab95-16862f99e7b2 req-a87fdd9c-5932-4642-8c61-bc95b5e7ea29 tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.513s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:10:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-5279e889-e1ee-4ede-ab95-16862f99e7b2 req-a87fdd9c-5932-4642-8c61-bc95b5e7ea29 tempest-TestInstancesWithCinderVolumes-867500636 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1', 'name': 'volume-414a408e-7cce-4788-895d-d6b21a8301e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75e2df28-db05-4cd9-8158-0fb78b8431a5', 'enforce_multipath': True} {{(pid=86977) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 13:10:06 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-5279e889-e1ee-4ede-ab95-16862f99e7b2 req-a87fdd9c-5932-4642-8c61-bc95b5e7ea29 tempest-TestInstancesWithCinderVolumes-867500636 None] attachment_update completed successfully. Jul 14 13:10:11 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-cb66281b-3a53-4b25-9983-aaa3a2c0d52b req-ed29e0f5-f710-470c-a19d-a044ccff10ff tempest-TestInstancesWithCinderVolumes-867500636 None] Terminate volume connection completed successfully. Jul 14 13:10:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-cb66281b-3a53-4b25-9983-aaa3a2c0d52b req-ed29e0f5-f710-470c-a19d-a044ccff10ff tempest-TestInstancesWithCinderVolumes-867500636 None] Deleting attachment 32c4deb0-4fdc-4bc5-920d-ceb7bd6ff3e0. {{(pid=86977) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 13:10:12 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1723163f-b3e0-4d16-8e24-8f4b1053816d tempest-TestInstancesWithCinderVolumes-867500636 None] Acquiring lock "cinder-a88438b3-31d9-41b8-8b8a-1ae7977c50b8-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:10:12 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1723163f-b3e0-4d16-8e24-8f4b1053816d tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "cinder-a88438b3-31d9-41b8-8b8a-1ae7977c50b8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:10:12 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1723163f-b3e0-4d16-8e24-8f4b1053816d tempest-TestInstancesWithCinderVolumes-867500636 None] Acquiring lock "cinder-quobyte-a88438b3-31d9-41b8-8b8a-1ae7977c50b8" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:10:12 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1723163f-b3e0-4d16-8e24-8f4b1053816d tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "cinder-quobyte-a88438b3-31d9-41b8-8b8a-1ae7977c50b8" acquired by "delete_volume" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:10:12 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71fedcd-c6ab-441f-8ead-79acc921381c]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:10:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1723163f-b3e0-4d16-8e24-8f4b1053816d tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a88438b3-31d9-41b8-8b8a-1ae7977c50b8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:13 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a88438b3-31d9-41b8-8b8a-1ae7977c50b8 Jul 14 13:10:13 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:13 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1723163f-b3e0-4d16-8e24-8f4b1053816d tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a88438b3-31d9-41b8-8b8a-1ae7977c50b8" returned: 0 in 0.492s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1723163f-b3e0-4d16-8e24-8f4b1053816d tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a88438b3-31d9-41b8-8b8a-1ae7977c50b8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:13 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a88438b3-31d9-41b8-8b8a-1ae7977c50b8 Jul 14 13:10:13 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:13 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1723163f-b3e0-4d16-8e24-8f4b1053816d tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a88438b3-31d9-41b8-8b8a-1ae7977c50b8" returned: 0 in 0.328s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1723163f-b3e0-4d16-8e24-8f4b1053816d tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "cinder-quobyte-a88438b3-31d9-41b8-8b8a-1ae7977c50b8" released by "delete_volume" :: held 0.871s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:10:13 devstack cinder-volume[86977]: WARNING cinder.quota [None req-1723163f-b3e0-4d16-8e24-8f4b1053816d tempest-TestInstancesWithCinderVolumes-867500636 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-119259457-1317160058 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-119259457-1317160058, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:10:13 devstack cinder-volume[86977]: WARNING cinder.quota [None req-1723163f-b3e0-4d16-8e24-8f4b1053816d tempest-TestInstancesWithCinderVolumes-867500636 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-119259457-1317160058 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-119259457-1317160058, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:10:13 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-1723163f-b3e0-4d16-8e24-8f4b1053816d tempest-TestInstancesWithCinderVolumes-867500636 None] Created reservations ['fe324ffe-9e8f-4537-919c-ff1c69bea4b7', 'b4feef9f-f5cd-4cd0-b476-71f9cc2f8c79', '7df2749a-ab15-438c-aa96-d2ed2e760841', 'c3f8ee3d-9892-4a2b-9750-154629b1dbe4'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:10:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1723163f-b3e0-4d16-8e24-8f4b1053816d tempest-TestInstancesWithCinderVolumes-867500636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:10:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1723163f-b3e0-4d16-8e24-8f4b1053816d tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:10:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1723163f-b3e0-4d16-8e24-8f4b1053816d tempest-TestInstancesWithCinderVolumes-867500636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:10:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1723163f-b3e0-4d16-8e24-8f4b1053816d tempest-TestInstancesWithCinderVolumes-867500636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:10:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1723163f-b3e0-4d16-8e24-8f4b1053816d tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:10:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1723163f-b3e0-4d16-8e24-8f4b1053816d tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:13 devstack sudo[103135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:10:13 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:14 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1723163f-b3e0-4d16-8e24-8f4b1053816d tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.350s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:14 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-1723163f-b3e0-4d16-8e24-8f4b1053816d tempest-TestInstancesWithCinderVolumes-867500636 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:10:14 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-1723163f-b3e0-4d16-8e24-8f4b1053816d tempest-TestInstancesWithCinderVolumes-867500636 None] Deleted volume successfully. Jul 14 13:10:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1723163f-b3e0-4d16-8e24-8f4b1053816d tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "cinder-a88438b3-31d9-41b8-8b8a-1ae7977c50b8-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:10:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:10:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:10:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:10:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:10:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:10:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:10:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:16 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:10:16 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:16 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.276s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:10:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:10:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 28 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 13:10:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 13:10:16 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-51e6a5b2-324d-49a8-9b34-7837332ce303 req-de4c6596-26e3-4965-8bf1-4e21d04c83d3 tempest-TestInstancesWithCinderVolumes-867500636 None] Terminate volume connection completed successfully. Jul 14 13:10:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-51e6a5b2-324d-49a8-9b34-7837332ce303 req-de4c6596-26e3-4965-8bf1-4e21d04c83d3 tempest-TestInstancesWithCinderVolumes-867500636 None] Deleting attachment 75e2df28-db05-4cd9-8158-0fb78b8431a5. {{(pid=86977) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 13:10:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-cab4263d-6c39-4be2-98cc-23b47a865943 tempest-TestInstancesWithCinderVolumes-867500636 None] Acquiring lock "cinder-414a408e-7cce-4788-895d-d6b21a8301e4-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:10:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-cab4263d-6c39-4be2-98cc-23b47a865943 tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "cinder-414a408e-7cce-4788-895d-d6b21a8301e4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:10:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-cab4263d-6c39-4be2-98cc-23b47a865943 tempest-TestInstancesWithCinderVolumes-867500636 None] Acquiring lock "cinder-quobyte-414a408e-7cce-4788-895d-d6b21a8301e4" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:10:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-cab4263d-6c39-4be2-98cc-23b47a865943 tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "cinder-quobyte-414a408e-7cce-4788-895d-d6b21a8301e4" acquired by "delete_volume" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:10:17 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc314675-ddbd-4c8d-bdb7-b3993adc7b6a]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:10:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cab4263d-6c39-4be2-98cc-23b47a865943 tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-414a408e-7cce-4788-895d-d6b21a8301e4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:17 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-414a408e-7cce-4788-895d-d6b21a8301e4 Jul 14 13:10:17 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:18 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cab4263d-6c39-4be2-98cc-23b47a865943 tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-414a408e-7cce-4788-895d-d6b21a8301e4" returned: 0 in 0.426s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cab4263d-6c39-4be2-98cc-23b47a865943 tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-414a408e-7cce-4788-895d-d6b21a8301e4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:18 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-414a408e-7cce-4788-895d-d6b21a8301e4 Jul 14 13:10:18 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:18 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cab4263d-6c39-4be2-98cc-23b47a865943 tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-414a408e-7cce-4788-895d-d6b21a8301e4" returned: 0 in 0.282s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-cab4263d-6c39-4be2-98cc-23b47a865943 tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "cinder-quobyte-414a408e-7cce-4788-895d-d6b21a8301e4" released by "delete_volume" :: held 0.765s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:10:18 devstack cinder-volume[86977]: WARNING cinder.quota [None req-cab4263d-6c39-4be2-98cc-23b47a865943 tempest-TestInstancesWithCinderVolumes-867500636 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1096592205-82440176 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1096592205-82440176, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:10:18 devstack cinder-volume[86977]: WARNING cinder.quota [None req-cab4263d-6c39-4be2-98cc-23b47a865943 tempest-TestInstancesWithCinderVolumes-867500636 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1096592205-82440176 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1096592205-82440176, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:10:18 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-cab4263d-6c39-4be2-98cc-23b47a865943 tempest-TestInstancesWithCinderVolumes-867500636 None] Created reservations ['f0b004d7-d335-4d84-911a-e8ce236b393f', '0235f044-f765-4d52-930d-a5ed400ac60b', 'ddbfbc7c-bb0b-4894-8ffe-de5f0d8171d1', '54c91dfa-baf5-4465-8a00-051e05954949'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:10:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-cab4263d-6c39-4be2-98cc-23b47a865943 tempest-TestInstancesWithCinderVolumes-867500636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:10:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-cab4263d-6c39-4be2-98cc-23b47a865943 tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:10:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-cab4263d-6c39-4be2-98cc-23b47a865943 tempest-TestInstancesWithCinderVolumes-867500636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:10:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-cab4263d-6c39-4be2-98cc-23b47a865943 tempest-TestInstancesWithCinderVolumes-867500636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:10:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-cab4263d-6c39-4be2-98cc-23b47a865943 tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:10:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cab4263d-6c39-4be2-98cc-23b47a865943 tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:18 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:10:18 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:18 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cab4263d-6c39-4be2-98cc-23b47a865943 tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.310s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:18 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-cab4263d-6c39-4be2-98cc-23b47a865943 tempest-TestInstancesWithCinderVolumes-867500636 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:10:18 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-cab4263d-6c39-4be2-98cc-23b47a865943 tempest-TestInstancesWithCinderVolumes-867500636 None] Deleted volume successfully. Jul 14 13:10:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-cab4263d-6c39-4be2-98cc-23b47a865943 tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "cinder-414a408e-7cce-4788-895d-d6b21a8301e4-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:10:22 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-1ac89357-e3ef-4b21-91fa-98496941b7ce req-578a94a5-a5ef-479e-950f-96cc8f4aa18e tempest-TestInstancesWithCinderVolumes-867500636 None] Terminate volume connection completed successfully. Jul 14 13:10:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-1ac89357-e3ef-4b21-91fa-98496941b7ce req-578a94a5-a5ef-479e-950f-96cc8f4aa18e tempest-TestInstancesWithCinderVolumes-867500636 None] Deleting attachment 8cbb2030-8670-404e-9350-4395694d6545. {{(pid=86977) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 13:10:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] Acquiring lock "cinder-e04b59c2-00c0-4369-aa7c-764d49b6ff7c-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:10:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "cinder-e04b59c2-00c0-4369-aa7c-764d49b6ff7c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:10:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] Acquiring lock "cinder-quobyte-e04b59c2-00c0-4369-aa7c-764d49b6ff7c" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:10:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "cinder-quobyte-e04b59c2-00c0-4369-aa7c-764d49b6ff7c" acquired by "delete_volume" :: waited 0.031s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:10:23 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[230b622f-b805-4782-9177-06388e511cfa]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:10:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:23 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c Jul 14 13:10:23 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:23 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c" returned: 0 in 0.442s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:24 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c Jul 14 13:10:24 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:24 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c" returned: 1 in 0.426s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:10:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:24 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c Jul 14 13:10:24 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:24 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e04b59c2-00c0-4369-aa7c-764d49b6ff7c" returned: 0 in 0.262s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "cinder-quobyte-e04b59c2-00c0-4369-aa7c-764d49b6ff7c" released by "delete_volume" :: held 1.229s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:10:24 devstack cinder-volume[86977]: WARNING cinder.quota [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1822148439-905970493 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1822148439-905970493, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:10:24 devstack cinder-volume[86977]: WARNING cinder.quota [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1822148439-905970493 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1822148439-905970493, it is now deprecated. Please use the default quota class for default quota. Jul 14 13:10:24 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] Created reservations ['41de7cb6-198a-4d85-bf04-4e9a2e997aab', 'fa64ad4b-558d-4215-b3be-179f83d5a899', '8057a975-e451-412c-b7ce-2d4dcb66ff5d', '77a6858e-69b4-4db2-95ad-1a7408ef5f25'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:10:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:10:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:10:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:10:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:10:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:10:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:24 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:10:24 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:25 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.252s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:25 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:10:25 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] Deleted volume successfully. Jul 14 13:10:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-9e74502e-9e1a-4808-ab5a-60ad3703eccc tempest-TestInstancesWithCinderVolumes-867500636 None] Lock "cinder-e04b59c2-00c0-4369-aa7c-764d49b6ff7c-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=113,cinder:INSERT=38,cinder:UPDATE=107,cinder:DELETE=11 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=97,cinder:INSERT=29,cinder:UPDATE=133,cinder:DELETE=5 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Flow 'volume_create_manager' (12470d24-7b03-4d7d-9389-934ff8e497cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa593426-29d8-4b49-9b88-f670b4733f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa593426-29d8-4b49-9b88-f670b4733f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1155315269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2370b4-775a-48d1-83d9-c17902635de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13328a60554b40889b17484aab612dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:10:28Z,use_quota=True,user_id='4d0596b30085453183fb7f1bec073921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1945cca-3127-4e57-bd48-933ed29bf5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1945cca-3127-4e57-bd48-933ed29bf5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0643005-7cc6-4263-beaa-c7af6a2f8bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0643005-7cc6-4263-beaa-c7af6a2f8bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d2370b4-775a-48d1-83d9-c17902635de1', 'volume_name': 'volume-9d2370b4-775a-48d1-83d9-c17902635de1', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d15a23be-8c1e-499d-9776-0639702f0712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d15a23be-8c1e-499d-9776-0639702f0712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2e8988-dfe5-492d-bf87-321232f1c6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:10:27 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Volume 9d2370b4-775a-48d1-83d9-c17902635de1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d2370b4-775a-48d1-83d9-c17902635de1', 'volume_size': 1} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1155315269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2370b4-775a-48d1-83d9-c17902635de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13328a60554b40889b17484aab612dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:10:28Z,use_quota=True,user_id='4d0596b30085453183fb7f1bec073921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Creating volume 9d2370b4-775a-48d1-83d9-c17902635de1 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:10:27 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:10:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:27 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1 1073741824 Jul 14 13:10:27 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:28 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1 1073741824" returned: 0 in 0.450s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:28 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1 Jul 14 13:10:28 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:28 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1" returned: 0 in 0.289s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:10:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:10:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2e8988-dfe5-492d-bf87-321232f1c6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d2370b4-775a-48d1-83d9-c17902635de1', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:10:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8588b879-2a17-4d99-a302-c814609c05d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:10:28 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Volume volume-9d2370b4-775a-48d1-83d9-c17902635de1 (9d2370b4-775a-48d1-83d9-c17902635de1): created successfully Jul 14 13:10:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8588b879-2a17-4d99-a302-c814609c05d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:10:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Flow 'volume_create_manager' (12470d24-7b03-4d7d-9389-934ff8e497cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:10:28 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-9f030862-c3bb-472f-8d7f-e4a3b6934e13 tempest-SnapshotDependencyTests-1318778566 None] Created volume successfully. Jul 14 13:10:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2ad71dd6-173c-4d72-a523-530b629744f2 tempest-SnapshotDependencyTests-1318778566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:10:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2ad71dd6-173c-4d72-a523-530b629744f2 tempest-SnapshotDependencyTests-1318778566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:10:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-2ad71dd6-173c-4d72-a523-530b629744f2 tempest-SnapshotDependencyTests-1318778566 None] Creating offline snapshot 8f4cc962-09b9-461a-930f-458724e7eea8 of volume 9d2370b4-775a-48d1-83d9-c17902635de1 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:10:30 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cb1127-d34f-48f2-a32f-d7fdbf511ce4]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:10:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad71dd6-173c-4d72-a523-530b629744f2 tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:30 devstack sudo[103238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1 Jul 14 13:10:30 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:30 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad71dd6-173c-4d72-a523-530b629744f2 tempest-SnapshotDependencyTests-1318778566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1" returned: 0 in 0.376s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad71dd6-173c-4d72-a523-530b629744f2 tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:30 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8 1G Jul 14 13:10:30 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:30 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad71dd6-173c-4d72-a523-530b629744f2 tempest-SnapshotDependencyTests-1318778566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8 1G" returned: 0 in 0.411s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad71dd6-173c-4d72-a523-530b629744f2 tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2370b4-775a-48d1-83d9-c17902635de1 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:30 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2370b4-775a-48d1-83d9-c17902635de1 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8 Jul 14 13:10:30 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:31 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad71dd6-173c-4d72-a523-530b629744f2 tempest-SnapshotDependencyTests-1318778566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2370b4-775a-48d1-83d9-c17902635de1 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8" returned: 0 in 0.321s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:31 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-2ad71dd6-173c-4d72-a523-530b629744f2 tempest-SnapshotDependencyTests-1318778566 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8 is being set with open permissions: ugo+rw Jul 14 13:10:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad71dd6-173c-4d72-a523-530b629744f2 tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:31 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8 Jul 14 13:10:31 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:31 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad71dd6-173c-4d72-a523-530b629744f2 tempest-SnapshotDependencyTests-1318778566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8" returned: 0 in 0.259s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad71dd6-173c-4d72-a523-530b629744f2 tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:31 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.info Jul 14 13:10:31 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:31 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad71dd6-173c-4d72-a523-530b629744f2 tempest-SnapshotDependencyTests-1318778566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.info" returned: 0 in 0.251s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:31 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-2ad71dd6-173c-4d72-a523-530b629744f2 tempest-SnapshotDependencyTests-1318778566 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.info is being set with open permissions: ugo+rw Jul 14 13:10:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad71dd6-173c-4d72-a523-530b629744f2 tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:31 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.info Jul 14 13:10:31 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:31 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2ad71dd6-173c-4d72-a523-530b629744f2 tempest-SnapshotDependencyTests-1318778566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.info" returned: 0 in 0.267s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2ad71dd6-173c-4d72-a523-530b629744f2 tempest-SnapshotDependencyTests-1318778566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.975s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:10:31 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-2ad71dd6-173c-4d72-a523-530b629744f2 tempest-SnapshotDependencyTests-1318778566 None] Create snapshot completed successfully Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Flow 'volume_create_manager' (df7055c3-4482-4b89-b7c5-6d59e3d3fdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (031c5fbf-74dc-439e-86a0-106361914ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (031c5fbf-74dc-439e-86a0-106361914ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=380696a8-5695-4984-9bd1-3ecb5175beaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13328a60554b40889b17484aab612dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8f4cc962-09b9-461a-930f-458724e7eea8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:10:33Z,use_quota=True,user_id='4d0596b30085453183fb7f1bec073921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07212a29-08d3-4752-bfc5-08286e34a4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07212a29-08d3-4752-bfc5-08286e34a4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7943c90-5fc7-41fd-acb2-8d07ea02f223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7943c90-5fc7-41fd-acb2-8d07ea02f223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '380696a8-5695-4984-9bd1-3ecb5175beaf', 'volume_name': 'volume-380696a8-5695-4984-9bd1-3ecb5175beaf', 'volume_size': 1, 'snapshot_id': '8f4cc962-09b9-461a-930f-458724e7eea8'}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d68bf00-f01c-4cb9-b22e-a83a74e4c6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d68bf00-f01c-4cb9-b22e-a83a74e4c6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a373eee6-8067-4a5b-893b-810d2b184ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:10:32 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Volume 380696a8-5695-4984-9bd1-3ecb5175beaf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-380696a8-5695-4984-9bd1-3ecb5175beaf', 'volume_size': 1, 'snapshot_id': '8f4cc962-09b9-461a-930f-458724e7eea8'} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Acquiring lock "cinder-quobyte-8f4cc962-09b9-461a-930f-458724e7eea8-380696a8-5695-4984-9bd1-3ecb5175beaf" by "_create_volume_from_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Lock "cinder-quobyte-8f4cc962-09b9-461a-930f-458724e7eea8-380696a8-5695-4984-9bd1-3ecb5175beaf" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Creating volume 380696a8-5695-4984-9bd1-3ecb5175beaf from snapshot 8f4cc962-09b9-461a-930f-458724e7eea8 {{(pid=86977) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Acquiring lock "cinder-quobyte-380696a8-5695-4984-9bd1-3ecb5175beaf" by "_copy_volume_from_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Lock "cinder-quobyte-380696a8-5695-4984-9bd1-3ecb5175beaf" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:10:32 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] snapshot: 8f4cc962-09b9-461a-930f-458724e7eea8, volume: 380696a8-5695-4984-9bd1-3ecb5175beaf, {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 13:10:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:10:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:10:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:10:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:10:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:10:33 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0086120-7e91-4ac2-aa33-874877238dbf]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:10:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:33 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8 Jul 14 13:10:33 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:33 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8" returned: 0 in 0.410s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d2370b4-775a-48d1-83d9-c17902635de1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:10:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1 {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 13:10:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Creating direct copy from snapshot {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 13:10:33 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a8f90b-fdf2-4b6f-ab81-c4ad4d03ee40]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:10:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:33 devstack sudo[103269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1 Jul 14 13:10:33 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:33 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1" returned: 0 in 0.393s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:33 devstack cinder-volume[86977]: DEBUG cinder.utils [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Path /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-380696a8-5695-4984-9bd1-3ecb5175beaf not found in is_blk_device check {{(pid=86977) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 13:10:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-380696a8-5695-4984-9bd1-3ecb5175beaf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:33 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-380696a8-5695-4984-9bd1-3ecb5175beaf Jul 14 13:10:33 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:38 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-380696a8-5695-4984-9bd1-3ecb5175beaf" returned: 0 in 4.682s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:38 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[12865dfd-7cce-4e0a-89aa-0e77ee9089cc]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:10:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:38 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1 Jul 14 13:10:38 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:39 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1" returned: 0 in 0.541s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:39 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Image conversion details: src /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1, size 1024.00 MB, duration 4.68 sec, destination /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-380696a8-5695-4984-9bd1-3ecb5175beaf {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:10:39 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Converted 1024.00 MB image at 218.63 MB/s Jul 14 13:10:39 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-380696a8-5695-4984-9bd1-3ecb5175beaf is being set with open permissions: ugo+rw Jul 14 13:10:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-380696a8-5695-4984-9bd1-3ecb5175beaf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:39 devstack sudo[103293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-380696a8-5695-4984-9bd1-3ecb5175beaf Jul 14 13:10:39 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:39 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-380696a8-5695-4984-9bd1-3ecb5175beaf" returned: 0 in 0.247s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Lock "cinder-quobyte-380696a8-5695-4984-9bd1-3ecb5175beaf" released by "_copy_volume_from_snapshot" :: held 6.392s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:10:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Lock "cinder-quobyte-8f4cc962-09b9-461a-930f-458724e7eea8-380696a8-5695-4984-9bd1-3ecb5175beaf" released by "_create_volume_from_snapshot" :: held 6.429s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:10:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.447s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:10:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a373eee6-8067-4a5b-893b-810d2b184ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-380696a8-5695-4984-9bd1-3ecb5175beaf', 'volume_size': 1, 'snapshot_id': '8f4cc962-09b9-461a-930f-458724e7eea8'}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:10:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09af9196-e1de-4a30-a23e-0133c6118b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:10:39 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Volume volume-380696a8-5695-4984-9bd1-3ecb5175beaf (380696a8-5695-4984-9bd1-3ecb5175beaf): created successfully Jul 14 13:10:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09af9196-e1de-4a30-a23e-0133c6118b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:10:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Flow 'volume_create_manager' (df7055c3-4482-4b89-b7c5-6d59e3d3fdf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:10:39 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-56a3af94-1958-4ca1-b3b9-4b5e278b8006 tempest-SnapshotDependencyTests-1318778566 None] Created volume successfully. Jul 14 13:10:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0cf49c46-c111-4133-9609-59e523cead69 tempest-SnapshotDependencyTests-1318778566 None] Acquiring lock "cinder-8f4cc962-09b9-461a-930f-458724e7eea8-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:10:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0cf49c46-c111-4133-9609-59e523cead69 tempest-SnapshotDependencyTests-1318778566 None] Lock "cinder-8f4cc962-09b9-461a-930f-458724e7eea8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:10:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0cf49c46-c111-4133-9609-59e523cead69 tempest-SnapshotDependencyTests-1318778566 None] Acquiring lock "cinder-quobyte-9d2370b4-775a-48d1-83d9-c17902635de1" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:10:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0cf49c46-c111-4133-9609-59e523cead69 tempest-SnapshotDependencyTests-1318778566 None] Lock "cinder-quobyte-9d2370b4-775a-48d1-83d9-c17902635de1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:10:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0cf49c46-c111-4133-9609-59e523cead69 tempest-SnapshotDependencyTests-1318778566 None] Acquiring lock "cinder-quobyte-8f4cc962-09b9-461a-930f-458724e7eea8" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:10:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0cf49c46-c111-4133-9609-59e523cead69 tempest-SnapshotDependencyTests-1318778566 None] Lock "cinder-quobyte-8f4cc962-09b9-461a-930f-458724e7eea8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:10:39 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-0cf49c46-c111-4133-9609-59e523cead69 tempest-SnapshotDependencyTests-1318778566 None] Deleting offline snapshot 8f4cc962-09b9-461a-930f-458724e7eea8 of volume 9d2370b4-775a-48d1-83d9-c17902635de1 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:10:39 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-0cf49c46-c111-4133-9609-59e523cead69 tempest-SnapshotDependencyTests-1318778566 None] snapshot_file for this snap is: volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:10:39 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9692e10-f558-474c-a797-af31e5295a6e]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:10:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0cf49c46-c111-4133-9609-59e523cead69 tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:39 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8 Jul 14 13:10:39 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:40 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0cf49c46-c111-4133-9609-59e523cead69 tempest-SnapshotDependencyTests-1318778566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8" returned: 0 in 0.368s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:40 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-0cf49c46-c111-4133-9609-59e523cead69 tempest-SnapshotDependencyTests-1318778566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d2370b4-775a-48d1-83d9-c17902635de1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:10:40 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42a4cb4-5dce-4fbd-ad63-39457afb1b1f]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:10:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0cf49c46-c111-4133-9609-59e523cead69 tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:40 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1 Jul 14 13:10:40 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:40 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0cf49c46-c111-4133-9609-59e523cead69 tempest-SnapshotDependencyTests-1318778566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1" returned: 0 in 0.408s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0cf49c46-c111-4133-9609-59e523cead69 tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:40 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8 Jul 14 13:10:40 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:40 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0cf49c46-c111-4133-9609-59e523cead69 tempest-SnapshotDependencyTests-1318778566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8" returned: 0 in 0.351s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0cf49c46-c111-4133-9609-59e523cead69 tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:40 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8 Jul 14 13:10:40 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:41 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0cf49c46-c111-4133-9609-59e523cead69 tempest-SnapshotDependencyTests-1318778566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1.8f4cc962-09b9-461a-930f-458724e7eea8" returned: 0 in 0.254s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:41 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0cf49c46-c111-4133-9609-59e523cead69 tempest-SnapshotDependencyTests-1318778566 None] Lock "cinder-quobyte-8f4cc962-09b9-461a-930f-458724e7eea8" released by "_delete_snapshot" :: held 1.480s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:10:41 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0cf49c46-c111-4133-9609-59e523cead69 tempest-SnapshotDependencyTests-1318778566 None] Lock "cinder-quobyte-9d2370b4-775a-48d1-83d9-c17902635de1" released by "delete_snapshot" :: held 1.504s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:10:41 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-0cf49c46-c111-4133-9609-59e523cead69 tempest-SnapshotDependencyTests-1318778566 None] Created reservations ['4fe06ede-0899-4b49-b555-7e895a32e3d2', '9c298f48-430c-4188-9c2f-8f1073c224be', '9beae692-8876-4424-84af-a28daff86cf7', 'd92cede6-e946-4ebf-afc4-3f94133716f0'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:10:41 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-0cf49c46-c111-4133-9609-59e523cead69 tempest-SnapshotDependencyTests-1318778566 None] Delete snapshot completed successfully. Jul 14 13:10:41 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0cf49c46-c111-4133-9609-59e523cead69 tempest-SnapshotDependencyTests-1318778566 None] Lock "cinder-8f4cc962-09b9-461a-930f-458724e7eea8-delete_snapshot" released by "delete_snapshot" :: held 1.642s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:10:41 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5964f79-38a6-4b31-bf68-10403eebe597 tempest-SnapshotDependencyTests-1318778566 None] Acquiring lock "cinder-9d2370b4-775a-48d1-83d9-c17902635de1-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:10:41 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5964f79-38a6-4b31-bf68-10403eebe597 tempest-SnapshotDependencyTests-1318778566 None] Lock "cinder-9d2370b4-775a-48d1-83d9-c17902635de1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:10:41 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5964f79-38a6-4b31-bf68-10403eebe597 tempest-SnapshotDependencyTests-1318778566 None] Acquiring lock "cinder-quobyte-9d2370b4-775a-48d1-83d9-c17902635de1" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:10:41 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5964f79-38a6-4b31-bf68-10403eebe597 tempest-SnapshotDependencyTests-1318778566 None] Lock "cinder-quobyte-9d2370b4-775a-48d1-83d9-c17902635de1" acquired by "delete_volume" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:10:41 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0928091-15fd-4226-b95c-1a9ae67cc4ef]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:10:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5964f79-38a6-4b31-bf68-10403eebe597 tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:42 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1 Jul 14 13:10:42 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:42 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5964f79-38a6-4b31-bf68-10403eebe597 tempest-SnapshotDependencyTests-1318778566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1" returned: 0 in 0.360s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5964f79-38a6-4b31-bf68-10403eebe597 tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:42 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1 Jul 14 13:10:42 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:42 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5964f79-38a6-4b31-bf68-10403eebe597 tempest-SnapshotDependencyTests-1318778566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9d2370b4-775a-48d1-83d9-c17902635de1" returned: 0 in 0.256s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:42 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5964f79-38a6-4b31-bf68-10403eebe597 tempest-SnapshotDependencyTests-1318778566 None] Lock "cinder-quobyte-9d2370b4-775a-48d1-83d9-c17902635de1" released by "delete_volume" :: held 0.682s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:10:42 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-b5964f79-38a6-4b31-bf68-10403eebe597 tempest-SnapshotDependencyTests-1318778566 None] Created reservations ['3152bc53-1f9d-4564-95a4-ce7fb225de7d', 'e752461d-d53f-467a-bc27-ace1b952b37e', 'a40c80d3-fc31-435b-8559-52365e246bd5', 'ab491850-7d55-47c3-9d6a-e65d093e0ec3'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:10:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b5964f79-38a6-4b31-bf68-10403eebe597 tempest-SnapshotDependencyTests-1318778566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:10:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b5964f79-38a6-4b31-bf68-10403eebe597 tempest-SnapshotDependencyTests-1318778566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:10:42 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b5964f79-38a6-4b31-bf68-10403eebe597 tempest-SnapshotDependencyTests-1318778566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:10:42 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b5964f79-38a6-4b31-bf68-10403eebe597 tempest-SnapshotDependencyTests-1318778566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:10:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b5964f79-38a6-4b31-bf68-10403eebe597 tempest-SnapshotDependencyTests-1318778566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:10:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5964f79-38a6-4b31-bf68-10403eebe597 tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:42 devstack sudo[103322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:10:42 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6ccd4663-2c1a-43ac-a2b4-231bd249c6fe tempest-SnapshotDependencyTests-1318778566 None] Acquiring lock "cinder-380696a8-5695-4984-9bd1-3ecb5175beaf-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:10:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6ccd4663-2c1a-43ac-a2b4-231bd249c6fe tempest-SnapshotDependencyTests-1318778566 None] Lock "cinder-380696a8-5695-4984-9bd1-3ecb5175beaf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:10:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6ccd4663-2c1a-43ac-a2b4-231bd249c6fe tempest-SnapshotDependencyTests-1318778566 None] Acquiring lock "cinder-quobyte-380696a8-5695-4984-9bd1-3ecb5175beaf" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:10:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6ccd4663-2c1a-43ac-a2b4-231bd249c6fe tempest-SnapshotDependencyTests-1318778566 None] Lock "cinder-quobyte-380696a8-5695-4984-9bd1-3ecb5175beaf" acquired by "delete_volume" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:10:43 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b5964f79-38a6-4b31-bf68-10403eebe597 tempest-SnapshotDependencyTests-1318778566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.347s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:43 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-b5964f79-38a6-4b31-bf68-10403eebe597 tempest-SnapshotDependencyTests-1318778566 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:10:43 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b5964f79-38a6-4b31-bf68-10403eebe597 tempest-SnapshotDependencyTests-1318778566 None] Deleted volume successfully. Jul 14 13:10:43 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b11fe9b-bd82-49b2-bd16-be4ccf25d26a]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:10:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6ccd4663-2c1a-43ac-a2b4-231bd249c6fe tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-380696a8-5695-4984-9bd1-3ecb5175beaf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b5964f79-38a6-4b31-bf68-10403eebe597 tempest-SnapshotDependencyTests-1318778566 None] Lock "cinder-9d2370b4-775a-48d1-83d9-c17902635de1-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:10:43 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-380696a8-5695-4984-9bd1-3ecb5175beaf Jul 14 13:10:43 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:43 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6ccd4663-2c1a-43ac-a2b4-231bd249c6fe tempest-SnapshotDependencyTests-1318778566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-380696a8-5695-4984-9bd1-3ecb5175beaf" returned: 0 in 0.436s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6ccd4663-2c1a-43ac-a2b4-231bd249c6fe tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-380696a8-5695-4984-9bd1-3ecb5175beaf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:43 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-380696a8-5695-4984-9bd1-3ecb5175beaf Jul 14 13:10:43 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:43 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6ccd4663-2c1a-43ac-a2b4-231bd249c6fe tempest-SnapshotDependencyTests-1318778566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-380696a8-5695-4984-9bd1-3ecb5175beaf" returned: 0 in 0.261s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6ccd4663-2c1a-43ac-a2b4-231bd249c6fe tempest-SnapshotDependencyTests-1318778566 None] Lock "cinder-quobyte-380696a8-5695-4984-9bd1-3ecb5175beaf" released by "delete_volume" :: held 0.758s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:10:43 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-6ccd4663-2c1a-43ac-a2b4-231bd249c6fe tempest-SnapshotDependencyTests-1318778566 None] Created reservations ['a322acc0-0870-4ccc-8b21-bbe39a190fe3', '39a79a01-c65b-46c9-a2e6-677183ca9bef', 'd86939ba-695e-46bd-8efe-19241d011f35', '58790f85-2a67-4ed1-9eca-ba6c27e4168e'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:10:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6ccd4663-2c1a-43ac-a2b4-231bd249c6fe tempest-SnapshotDependencyTests-1318778566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:10:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6ccd4663-2c1a-43ac-a2b4-231bd249c6fe tempest-SnapshotDependencyTests-1318778566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:10:44 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6ccd4663-2c1a-43ac-a2b4-231bd249c6fe tempest-SnapshotDependencyTests-1318778566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:10:44 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6ccd4663-2c1a-43ac-a2b4-231bd249c6fe tempest-SnapshotDependencyTests-1318778566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:10:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6ccd4663-2c1a-43ac-a2b4-231bd249c6fe tempest-SnapshotDependencyTests-1318778566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:10:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6ccd4663-2c1a-43ac-a2b4-231bd249c6fe tempest-SnapshotDependencyTests-1318778566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:10:44 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:10:44 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:10:44 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Jul 14 13:10:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6ccd4663-2c1a-43ac-a2b4-231bd249c6fe tempest-SnapshotDependencyTests-1318778566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.285s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:10:44 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-6ccd4663-2c1a-43ac-a2b4-231bd249c6fe tempest-SnapshotDependencyTests-1318778566 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:10:44 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-6ccd4663-2c1a-43ac-a2b4-231bd249c6fe tempest-SnapshotDependencyTests-1318778566 None] Deleted volume successfully. Jul 14 13:10:44 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6ccd4663-2c1a-43ac-a2b4-231bd249c6fe tempest-SnapshotDependencyTests-1318778566 None] Lock "cinder-380696a8-5695-4984-9bd1-3ecb5175beaf-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:10:54 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=22,cinder:UPDATE=31,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:10:54 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=24,cinder:INSERT=6,cinder:UPDATE=24,cinder:DELETE=3 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:11:10 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:11:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Flow 'volume_create_manager' (fab9fc8a-311f-407f-a0d3-c261c5752971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:11:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10efa99c-940d-4614-a0f6-b9feb1393433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:11:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10efa99c-940d-4614-a0f6-b9feb1393433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1401064025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba83aeb-d11a-4740-b6f4-8cc9313b819c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab121da86b884a2e9819c737a4be966f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:11:11Z,use_quota=True,user_id='33fe5cdb64874c19b3d5ebb04fef0e29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:11:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5aeb52d-92c1-42b9-a3be-151be762ae18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:11:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5aeb52d-92c1-42b9-a3be-151be762ae18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:11:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5202b1cb-5fa1-45d2-a1c8-a7436c696c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:11:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5202b1cb-5fa1-45d2-a1c8-a7436c696c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eba83aeb-d11a-4740-b6f4-8cc9313b819c', 'volume_name': 'volume-eba83aeb-d11a-4740-b6f4-8cc9313b819c', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:11:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab02d78-bdf2-48bd-9d5f-ef4f6dbfac6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:11:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab02d78-bdf2-48bd-9d5f-ef4f6dbfac6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:11:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e470c8ea-cb81-4c03-abed-910617572f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:11:10 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Volume eba83aeb-d11a-4740-b6f4-8cc9313b819c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eba83aeb-d11a-4740-b6f4-8cc9313b819c', 'volume_size': 1} Jul 14 13:11:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:11:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:11:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1401064025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba83aeb-d11a-4740-b6f4-8cc9313b819c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab121da86b884a2e9819c737a4be966f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:11:11Z,use_quota=True,user_id='33fe5cdb64874c19b3d5ebb04fef0e29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:11:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Creating volume eba83aeb-d11a-4740-b6f4-8cc9313b819c {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:11:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:11:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:11:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:11:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:11:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:11:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:11:10 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:11:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-eba83aeb-d11a-4740-b6f4-8cc9313b819c 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:11:10 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-eba83aeb-d11a-4740-b6f4-8cc9313b819c 1073741824 Jul 14 13:11:10 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:11:11 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Jul 14 13:11:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-eba83aeb-d11a-4740-b6f4-8cc9313b819c 1073741824" returned: 0 in 0.416s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:11:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-eba83aeb-d11a-4740-b6f4-8cc9313b819c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:11:11 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-eba83aeb-d11a-4740-b6f4-8cc9313b819c Jul 14 13:11:11 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:11:11 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Jul 14 13:11:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-eba83aeb-d11a-4740-b6f4-8cc9313b819c" returned: 0 in 0.261s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:11:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:11:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:11:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e470c8ea-cb81-4c03-abed-910617572f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eba83aeb-d11a-4740-b6f4-8cc9313b819c', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:11:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5490d96d-8719-4f1d-a7b5-048329b622c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:11:11 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Volume volume-eba83aeb-d11a-4740-b6f4-8cc9313b819c (eba83aeb-d11a-4740-b6f4-8cc9313b819c): created successfully Jul 14 13:11:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5490d96d-8719-4f1d-a7b5-048329b622c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:11:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Flow 'volume_create_manager' (fab9fc8a-311f-407f-a0d3-c261c5752971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:11:11 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-a4329d60-5738-4510-9f13-b7b1b9b7d543 tempest-TestMinimumBasicScenario-1499183295 None] Created volume successfully. Jul 14 13:11:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-56bf477d-92a7-435c-823b-213c2d847c31 req-37aaf2bf-3683-4198-bfd1-10592d10c513 tempest-TestMinimumBasicScenario-1499183295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:11:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-56bf477d-92a7-435c-823b-213c2d847c31 req-37aaf2bf-3683-4198-bfd1-10592d10c513 tempest-TestMinimumBasicScenario-1499183295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:11:12 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a58dc9e-2142-4ae4-9eee-4d6c2e575b0c]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:11:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-56bf477d-92a7-435c-823b-213c2d847c31 req-37aaf2bf-3683-4198-bfd1-10592d10c513 tempest-TestMinimumBasicScenario-1499183295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-eba83aeb-d11a-4740-b6f4-8cc9313b819c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:11:12 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-eba83aeb-d11a-4740-b6f4-8cc9313b819c Jul 14 13:11:12 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:11:12 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Jul 14 13:11:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-56bf477d-92a7-435c-823b-213c2d847c31 req-37aaf2bf-3683-4198-bfd1-10592d10c513 tempest-TestMinimumBasicScenario-1499183295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-eba83aeb-d11a-4740-b6f4-8cc9313b819c" returned: 0 in 0.364s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:11:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-56bf477d-92a7-435c-823b-213c2d847c31 req-37aaf2bf-3683-4198-bfd1-10592d10c513 tempest-TestMinimumBasicScenario-1499183295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.386s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:11:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-56bf477d-92a7-435c-823b-213c2d847c31 req-37aaf2bf-3683-4198-bfd1-10592d10c513 tempest-TestMinimumBasicScenario-1499183295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1', 'name': 'volume-eba83aeb-d11a-4740-b6f4-8cc9313b819c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60b9cd69-c8ff-4fe7-982a-b9139e6a8844', 'enforce_multipath': True} {{(pid=86977) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 13:11:12 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-56bf477d-92a7-435c-823b-213c2d847c31 req-37aaf2bf-3683-4198-bfd1-10592d10c513 tempest-TestMinimumBasicScenario-1499183295 None] attachment_update completed successfully. Jul 14 13:11:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:11:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:11:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:11:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:11:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:11:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:11:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:11:16 devstack sudo[103892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:11:16 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:11:16 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root Jul 14 13:11:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.285s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:11:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:11:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:11:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 28 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 13:11:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 13:11:22 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:11:22 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:UPDATE=4,cinder:SELECT=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:11:58 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-5eb7ac69-d58e-4837-8f7d-494c450f5353 req-b24550ec-eb93-4524-ab85-21dd885b88b8 tempest-TestMinimumBasicScenario-1499183295 None] Terminate volume connection completed successfully. Jul 14 13:11:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-5eb7ac69-d58e-4837-8f7d-494c450f5353 req-b24550ec-eb93-4524-ab85-21dd885b88b8 tempest-TestMinimumBasicScenario-1499183295 None] Deleting attachment 60b9cd69-c8ff-4fe7-982a-b9139e6a8844. {{(pid=86977) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 13:11:59 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-965109b7-400d-4c4a-a745-78defa4b593c tempest-TestMinimumBasicScenario-1499183295 None] Acquiring lock "cinder-eba83aeb-d11a-4740-b6f4-8cc9313b819c-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:11:59 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-965109b7-400d-4c4a-a745-78defa4b593c tempest-TestMinimumBasicScenario-1499183295 None] Lock "cinder-eba83aeb-d11a-4740-b6f4-8cc9313b819c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:11:59 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-965109b7-400d-4c4a-a745-78defa4b593c tempest-TestMinimumBasicScenario-1499183295 None] Acquiring lock "cinder-quobyte-eba83aeb-d11a-4740-b6f4-8cc9313b819c" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:11:59 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-965109b7-400d-4c4a-a745-78defa4b593c tempest-TestMinimumBasicScenario-1499183295 None] Lock "cinder-quobyte-eba83aeb-d11a-4740-b6f4-8cc9313b819c" acquired by "delete_volume" :: waited 0.013s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:11:59 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57eb3d3-ada7-41f6-95f3-74aacda12dd4]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:11:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-965109b7-400d-4c4a-a745-78defa4b593c tempest-TestMinimumBasicScenario-1499183295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-eba83aeb-d11a-4740-b6f4-8cc9313b819c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:11:59 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-eba83aeb-d11a-4740-b6f4-8cc9313b819c Jul 14 13:11:59 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:12:00 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Jul 14 13:12:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-965109b7-400d-4c4a-a745-78defa4b593c tempest-TestMinimumBasicScenario-1499183295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-eba83aeb-d11a-4740-b6f4-8cc9313b819c" returned: 0 in 0.357s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:12:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-965109b7-400d-4c4a-a745-78defa4b593c tempest-TestMinimumBasicScenario-1499183295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-eba83aeb-d11a-4740-b6f4-8cc9313b819c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:12:00 devstack sudo[104015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-eba83aeb-d11a-4740-b6f4-8cc9313b819c Jul 14 13:12:00 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:12:00 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root Jul 14 13:12:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-965109b7-400d-4c4a-a745-78defa4b593c tempest-TestMinimumBasicScenario-1499183295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-eba83aeb-d11a-4740-b6f4-8cc9313b819c" returned: 0 in 0.244s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:12:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-965109b7-400d-4c4a-a745-78defa4b593c tempest-TestMinimumBasicScenario-1499183295 None] Lock "cinder-quobyte-eba83aeb-d11a-4740-b6f4-8cc9313b819c" released by "delete_volume" :: held 0.637s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:12:00 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-965109b7-400d-4c4a-a745-78defa4b593c tempest-TestMinimumBasicScenario-1499183295 None] Created reservations ['12119534-c0a1-4f6b-b700-4452e0aef6c4', 'bbf073bb-7ffc-4f28-abee-acae52f528e8', '14a98958-60fa-4188-a6fc-5bd177153c48', '5bde6de7-a6a5-42a3-bc8c-bbffac7486cb'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:12:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-965109b7-400d-4c4a-a745-78defa4b593c tempest-TestMinimumBasicScenario-1499183295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:12:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-965109b7-400d-4c4a-a745-78defa4b593c tempest-TestMinimumBasicScenario-1499183295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:12:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-965109b7-400d-4c4a-a745-78defa4b593c tempest-TestMinimumBasicScenario-1499183295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:12:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-965109b7-400d-4c4a-a745-78defa4b593c tempest-TestMinimumBasicScenario-1499183295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:12:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-965109b7-400d-4c4a-a745-78defa4b593c tempest-TestMinimumBasicScenario-1499183295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:12:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-965109b7-400d-4c4a-a745-78defa4b593c tempest-TestMinimumBasicScenario-1499183295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:12:00 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:12:00 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:12:00 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Jul 14 13:12:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-965109b7-400d-4c4a-a745-78defa4b593c tempest-TestMinimumBasicScenario-1499183295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.241s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:12:00 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-965109b7-400d-4c4a-a745-78defa4b593c tempest-TestMinimumBasicScenario-1499183295 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:12:00 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-965109b7-400d-4c4a-a745-78defa4b593c tempest-TestMinimumBasicScenario-1499183295 None] Deleted volume successfully. Jul 14 13:12:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-965109b7-400d-4c4a-a745-78defa4b593c tempest-TestMinimumBasicScenario-1499183295 None] Lock "cinder-eba83aeb-d11a-4740-b6f4-8cc9313b819c-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:12:10 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=3 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:12:10 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:12:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:12:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:12:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:12:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:12:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:12:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:12:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:12:16 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:12:16 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:12:16 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Jul 14 13:12:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.239s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:12:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:12:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:12:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 28 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 13:12:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 13:12:23 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=1 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:12:23 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:UPDATE=1 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Flow 'volume_create_manager' (0355a7ac-1954-4073-b176-d01ed7d54889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b1dcc69-2ecf-4df8-a021-bc54d479d23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b1dcc69-2ecf-4df8-a021-bc54d479d23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-150308886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9878fdc0214842f28184fc71c8bda77b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:13:01Z,use_quota=True,user_id='463c791e1292421e827db33498d8d340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dac8b30-bb8e-4797-8668-cf2bdab7a0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dac8b30-bb8e-4797-8668-cf2bdab7a0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e401c9-18cc-4d7f-a17d-8dec45fd15f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e401c9-18cc-4d7f-a17d-8dec45fd15f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6', 'volume_name': 'volume-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b714a102-9405-4f4f-88ff-7034993e3146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b714a102-9405-4f4f-88ff-7034993e3146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (578c3a06-9ff2-48fc-b43a-b6919ce4e375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:13:01 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Volume abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6', 'volume_size': 1} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-150308886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9878fdc0214842f28184fc71c8bda77b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:13:01Z,use_quota=True,user_id='463c791e1292421e827db33498d8d340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Creating volume abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:13:01 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:13:01 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6 1073741824 Jul 14 13:13:01 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:13:01 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6 1073741824" returned: 0 in 0.417s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:13:01 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6 Jul 14 13:13:01 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:13:01 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6" returned: 0 in 0.248s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (578c3a06-9ff2-48fc-b43a-b6919ce4e375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c0f06f-5f0e-4845-bdef-d267f145af3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:13:01 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Volume volume-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6 (abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6): created successfully Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c0f06f-5f0e-4845-bdef-d267f145af3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:13:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Flow 'volume_create_manager' (0355a7ac-1954-4073-b176-d01ed7d54889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:13:01 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-db7dd5ea-121b-40eb-85ea-884a27f1b163 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Created volume successfully. Jul 14 13:13:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-fbc1c8b0-b23f-4900-b338-a4eea85173e0 req-a5431e21-3c18-4c8b-8d5e-3c78422b5dc8 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:13:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-fbc1c8b0-b23f-4900-b338-a4eea85173e0 req-a5431e21-3c18-4c8b-8d5e-3c78422b5dc8 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:13:02 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56d1847-bc9d-4a98-ae42-f8e7d752662b]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:13:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-fbc1c8b0-b23f-4900-b338-a4eea85173e0 req-a5431e21-3c18-4c8b-8d5e-3c78422b5dc8 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:13:02 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6 Jul 14 13:13:02 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:13:03 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Jul 14 13:13:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-fbc1c8b0-b23f-4900-b338-a4eea85173e0 req-a5431e21-3c18-4c8b-8d5e-3c78422b5dc8 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6" returned: 0 in 0.358s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:13:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-fbc1c8b0-b23f-4900-b338-a4eea85173e0 req-a5431e21-3c18-4c8b-8d5e-3c78422b5dc8 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.374s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:13:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-fbc1c8b0-b23f-4900-b338-a4eea85173e0 req-a5431e21-3c18-4c8b-8d5e-3c78422b5dc8 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1', 'name': 'volume-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4da7c97-389d-4f3e-b5ec-a8c2b99aac37', 'enforce_multipath': True} {{(pid=86977) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 13:13:03 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-fbc1c8b0-b23f-4900-b338-a4eea85173e0 req-a5431e21-3c18-4c8b-8d5e-3c78422b5dc8 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] attachment_update completed successfully. Jul 14 13:13:05 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-9c24fe51-f09e-4b16-9755-30c98d8c0e75 req-213caf2f-f565-4f95-b6bf-8f4aa2751a42 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Terminate volume connection completed successfully. Jul 14 13:13:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-9c24fe51-f09e-4b16-9755-30c98d8c0e75 req-213caf2f-f565-4f95-b6bf-8f4aa2751a42 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Deleting attachment b4da7c97-389d-4f3e-b5ec-a8c2b99aac37. {{(pid=86977) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 13:13:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-476cab33-7855-43c5-8931-34f7787023b5 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Acquiring lock "cinder-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:13:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-476cab33-7855-43c5-8931-34f7787023b5 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Lock "cinder-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:13:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-476cab33-7855-43c5-8931-34f7787023b5 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Acquiring lock "cinder-quobyte-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:13:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-476cab33-7855-43c5-8931-34f7787023b5 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Lock "cinder-quobyte-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6" acquired by "delete_volume" :: waited 0.013s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:13:06 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b35c405-d862-4219-b421-74144c0f982e]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:13:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-476cab33-7855-43c5-8931-34f7787023b5 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:13:07 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6 Jul 14 13:13:07 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:13:07 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Jul 14 13:13:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-476cab33-7855-43c5-8931-34f7787023b5 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6" returned: 0 in 0.350s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:13:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-476cab33-7855-43c5-8931-34f7787023b5 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:13:07 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6 Jul 14 13:13:07 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:13:07 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Jul 14 13:13:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-476cab33-7855-43c5-8931-34f7787023b5 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6" returned: 0 in 0.239s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:13:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-476cab33-7855-43c5-8931-34f7787023b5 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Lock "cinder-quobyte-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6" released by "delete_volume" :: held 0.626s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:13:07 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-476cab33-7855-43c5-8931-34f7787023b5 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Created reservations ['7d9baac7-bc9f-42f6-b875-93d071da17de', '426c2359-fba9-40aa-a334-45ac621dfa68', 'dd208032-889f-451b-80da-0af8a4f3aa42', '282f88f1-6ac5-4926-9fee-1f0ed1bce3c4'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:13:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-476cab33-7855-43c5-8931-34f7787023b5 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:13:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-476cab33-7855-43c5-8931-34f7787023b5 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:13:07 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-476cab33-7855-43c5-8931-34f7787023b5 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:13:07 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-476cab33-7855-43c5-8931-34f7787023b5 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:13:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-476cab33-7855-43c5-8931-34f7787023b5 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:13:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-476cab33-7855-43c5-8931-34f7787023b5 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:13:07 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:13:07 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:13:07 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jul 14 13:13:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-476cab33-7855-43c5-8931-34f7787023b5 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.252s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:13:07 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-476cab33-7855-43c5-8931-34f7787023b5 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:13:07 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-476cab33-7855-43c5-8931-34f7787023b5 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Deleted volume successfully. Jul 14 13:13:08 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-476cab33-7855-43c5-8931-34f7787023b5 tempest-TestServerVolumeAttachScenarioOldVersion-811649874 None] Lock "cinder-abd5cfdc-d6c2-4b38-a12d-555f0e4a7fb6-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:13:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:13:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:13:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:13:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:13:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:13:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:13:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:13:16 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:13:16 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:13:16 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Jul 14 13:13:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.275s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:13:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:13:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:13:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 28 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 13:13:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 13:13:17 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=14,cinder:INSERT=2,cinder:UPDATE=11 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:13:17 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=13,cinder:UPDATE=14,cinder:DELETE=2,cinder:INSERT=3 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Flow 'volume_create_manager' (9648b02a-2e0b-4971-845c-07b4e43875d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eafb9c71-6368-447f-895a-57b9be2838ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eafb9c71-6368-447f-895a-57b9be2838ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-94110546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daba5b97-ed53-4017-abc1-6dde035676e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f2207662ed43d2bae9a15355f4f9de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:13:39Z,use_quota=True,user_id='8460a22cc7f344a39cae720424d8b68b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b5453e-ecd9-4210-b2e1-40e80cd82151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b5453e-ecd9-4210-b2e1-40e80cd82151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8df37c9-6857-428a-8116-bb2c35394a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8df37c9-6857-428a-8116-bb2c35394a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daba5b97-ed53-4017-abc1-6dde035676e3', 'volume_name': 'volume-daba5b97-ed53-4017-abc1-6dde035676e3', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d0c66e-ee3b-4034-8344-e9fb00dad089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d0c66e-ee3b-4034-8344-e9fb00dad089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0bf9c6-9a8a-46a2-8253-8c3731037b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:13:39 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Volume daba5b97-ed53-4017-abc1-6dde035676e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daba5b97-ed53-4017-abc1-6dde035676e3', 'volume_size': 1} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-94110546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daba5b97-ed53-4017-abc1-6dde035676e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f2207662ed43d2bae9a15355f4f9de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:13:39Z,use_quota=True,user_id='8460a22cc7f344a39cae720424d8b68b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Creating volume daba5b97-ed53-4017-abc1-6dde035676e3 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:13:39 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-daba5b97-ed53-4017-abc1-6dde035676e3 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:13:39 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-daba5b97-ed53-4017-abc1-6dde035676e3 1073741824 Jul 14 13:13:39 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Flow 'volume_create_manager' (ddf08dfe-8f57-419d-bf03-a57d85039e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de673fb-4439-4d8a-ba81-01b38e7365de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de673fb-4439-4d8a-ba81-01b38e7365de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1885004244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4977cf-f3d5-4c25-873c-06e8479171e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f2207662ed43d2bae9a15355f4f9de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:13:40Z,use_quota=True,user_id='8460a22cc7f344a39cae720424d8b68b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc02215-ba2d-4d2a-b88e-7a392e2a106b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc02215-ba2d-4d2a-b88e-7a392e2a106b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b964daa4-82de-499b-9bc6-3be3319b9fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b964daa4-82de-499b-9bc6-3be3319b9fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da4977cf-f3d5-4c25-873c-06e8479171e3', 'volume_name': 'volume-da4977cf-f3d5-4c25-873c-06e8479171e3', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46abb03e-c342-4721-b5da-b9225a3497e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46abb03e-c342-4721-b5da-b9225a3497e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (948237fa-69c3-4d69-b396-169dd978a630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:13:39 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Volume da4977cf-f3d5-4c25-873c-06e8479171e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da4977cf-f3d5-4c25-873c-06e8479171e3', 'volume_size': 1} Jul 14 13:13:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:13:40 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Jul 14 13:13:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-daba5b97-ed53-4017-abc1-6dde035676e3 1073741824" returned: 0 in 0.490s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:13:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-daba5b97-ed53-4017-abc1-6dde035676e3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:13:40 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-daba5b97-ed53-4017-abc1-6dde035676e3 Jul 14 13:13:40 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:13:40 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jul 14 13:13:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-daba5b97-ed53-4017-abc1-6dde035676e3" returned: 0 in 0.247s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:13:40 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:13:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:13:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.398s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:13:40 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1885004244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4977cf-f3d5-4c25-873c-06e8479171e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f2207662ed43d2bae9a15355f4f9de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:13:40Z,use_quota=True,user_id='8460a22cc7f344a39cae720424d8b68b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:13:40 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Creating volume da4977cf-f3d5-4c25-873c-06e8479171e3 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:13:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:13:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:13:40 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:13:40 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:13:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:13:40 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:13:40 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:13:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da4977cf-f3d5-4c25-873c-06e8479171e3 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:13:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0bf9c6-9a8a-46a2-8253-8c3731037b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daba5b97-ed53-4017-abc1-6dde035676e3', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:13:40 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da4977cf-f3d5-4c25-873c-06e8479171e3 1073741824 Jul 14 13:13:40 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:13:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a465773c-1c7e-49ac-9a44-7ba579e8f875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:13:40 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Volume volume-daba5b97-ed53-4017-abc1-6dde035676e3 (daba5b97-ed53-4017-abc1-6dde035676e3): created successfully Jul 14 13:13:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a465773c-1c7e-49ac-9a44-7ba579e8f875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:13:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Flow 'volume_create_manager' (9648b02a-2e0b-4971-845c-07b4e43875d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:13:40 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-aa4e262f-f07d-41c0-8f18-1efad436ec4f tempest-TestServerVolumeAttachmentScenario-1615696183 None] Created volume successfully. Jul 14 13:13:40 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Jul 14 13:13:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da4977cf-f3d5-4c25-873c-06e8479171e3 1073741824" returned: 0 in 0.475s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:13:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da4977cf-f3d5-4c25-873c-06e8479171e3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:13:40 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da4977cf-f3d5-4c25-873c-06e8479171e3 Jul 14 13:13:40 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:13:41 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Jul 14 13:13:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da4977cf-f3d5-4c25-873c-06e8479171e3" returned: 0 in 0.251s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:13:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:13:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:13:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (948237fa-69c3-4d69-b396-169dd978a630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da4977cf-f3d5-4c25-873c-06e8479171e3', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:13:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63a36a3-00ed-4026-b1d1-5e41286c2a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:13:41 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Volume volume-da4977cf-f3d5-4c25-873c-06e8479171e3 (da4977cf-f3d5-4c25-873c-06e8479171e3): created successfully Jul 14 13:13:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63a36a3-00ed-4026-b1d1-5e41286c2a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:13:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Flow 'volume_create_manager' (ddf08dfe-8f57-419d-bf03-a57d85039e86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:13:41 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-a369dcb6-ff77-418c-8358-603d08f6b6ff tempest-TestServerVolumeAttachmentScenario-1615696183 None] Created volume successfully. Jul 14 13:13:51 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:UPDATE=6,cinder:SELECT=5,cinder:DELETE=1 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:13:51 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=3,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:14:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-7dffaa80-2118-4b08-8af2-a3e0d01d386e req-46919f2e-2740-4725-b223-68aeaa368684 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:14:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-7dffaa80-2118-4b08-8af2-a3e0d01d386e req-46919f2e-2740-4725-b223-68aeaa368684 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:14:09 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc49a801-815b-4f2d-8869-321cd498c775]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:14:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-7dffaa80-2118-4b08-8af2-a3e0d01d386e req-46919f2e-2740-4725-b223-68aeaa368684 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-daba5b97-ed53-4017-abc1-6dde035676e3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:10 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-daba5b97-ed53-4017-abc1-6dde035676e3 Jul 14 13:14:10 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:10 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-7dffaa80-2118-4b08-8af2-a3e0d01d386e req-46919f2e-2740-4725-b223-68aeaa368684 tempest-TestServerVolumeAttachmentScenario-1615696183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-daba5b97-ed53-4017-abc1-6dde035676e3" returned: 0 in 0.349s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-7dffaa80-2118-4b08-8af2-a3e0d01d386e req-46919f2e-2740-4725-b223-68aeaa368684 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.368s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:14:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-7dffaa80-2118-4b08-8af2-a3e0d01d386e req-46919f2e-2740-4725-b223-68aeaa368684 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1', 'name': 'volume-daba5b97-ed53-4017-abc1-6dde035676e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41912246-1b32-4336-ba7e-ca81bc09e165', 'enforce_multipath': True} {{(pid=86977) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 13:14:10 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-7dffaa80-2118-4b08-8af2-a3e0d01d386e req-46919f2e-2740-4725-b223-68aeaa368684 tempest-TestServerVolumeAttachmentScenario-1615696183 None] attachment_update completed successfully. Jul 14 13:14:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-c0e734f3-67d9-4397-adf8-261383a1b59f req-947214e0-0d68-4e25-8afc-625bc45fb147 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:14:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-c0e734f3-67d9-4397-adf8-261383a1b59f req-947214e0-0d68-4e25-8afc-625bc45fb147 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:14:14 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[9251b5c2-19cb-4406-af4e-4d4ca1b07e8b]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:14:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-c0e734f3-67d9-4397-adf8-261383a1b59f req-947214e0-0d68-4e25-8afc-625bc45fb147 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da4977cf-f3d5-4c25-873c-06e8479171e3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:14 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da4977cf-f3d5-4c25-873c-06e8479171e3 Jul 14 13:14:14 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:14 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [req-c0e734f3-67d9-4397-adf8-261383a1b59f req-947214e0-0d68-4e25-8afc-625bc45fb147 tempest-TestServerVolumeAttachmentScenario-1615696183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da4977cf-f3d5-4c25-873c-06e8479171e3" returned: 0 in 0.356s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [req-c0e734f3-67d9-4397-adf8-261383a1b59f req-947214e0-0d68-4e25-8afc-625bc45fb147 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.373s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:14:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-c0e734f3-67d9-4397-adf8-261383a1b59f req-947214e0-0d68-4e25-8afc-625bc45fb147 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1', 'name': 'volume-da4977cf-f3d5-4c25-873c-06e8479171e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d6d9806-e303-4e2f-befb-055b7fc0553a', 'enforce_multipath': True} {{(pid=86977) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 13:14:14 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-c0e734f3-67d9-4397-adf8-261383a1b59f req-947214e0-0d68-4e25-8afc-625bc45fb147 tempest-TestServerVolumeAttachmentScenario-1615696183 None] attachment_update completed successfully. Jul 14 13:14:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:14:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:14:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:14:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:14:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:14:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:14:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:16 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:14:16 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:16 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.254s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:14:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:14:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 28 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 13:14:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 13:14:17 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-b0ba660b-b66a-43e6-9e55-bf3602b28f8c req-3c964b72-d922-4303-97d0-892cb2a83940 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Terminate volume connection completed successfully. Jul 14 13:14:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-b0ba660b-b66a-43e6-9e55-bf3602b28f8c req-3c964b72-d922-4303-97d0-892cb2a83940 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Deleting attachment 7d6d9806-e303-4e2f-befb-055b7fc0553a. {{(pid=86977) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 13:14:18 devstack cinder-volume[86977]: INFO cinder.volume.manager [req-3adfd140-9e54-4b9a-8465-5c0a1a1796ef req-f3d707bd-2bd1-453f-97a5-779e6e4121be tempest-TestServerVolumeAttachmentScenario-1615696183 None] Terminate volume connection completed successfully. Jul 14 13:14:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [req-3adfd140-9e54-4b9a-8465-5c0a1a1796ef req-f3d707bd-2bd1-453f-97a5-779e6e4121be tempest-TestServerVolumeAttachmentScenario-1615696183 None] Deleting attachment 41912246-1b32-4336-ba7e-ca81bc09e165. {{(pid=86977) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 13:14:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-82903cb3-dc2a-4da3-b971-bd4e58131240 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Acquiring lock "cinder-da4977cf-f3d5-4c25-873c-06e8479171e3-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:14:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-82903cb3-dc2a-4da3-b971-bd4e58131240 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "cinder-da4977cf-f3d5-4c25-873c-06e8479171e3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:14:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-82903cb3-dc2a-4da3-b971-bd4e58131240 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Acquiring lock "cinder-quobyte-da4977cf-f3d5-4c25-873c-06e8479171e3" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:14:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-82903cb3-dc2a-4da3-b971-bd4e58131240 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "cinder-quobyte-da4977cf-f3d5-4c25-873c-06e8479171e3" acquired by "delete_volume" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:14:22 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44fb004-fe24-46af-9486-0d045e79ba3d]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:14:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-82903cb3-dc2a-4da3-b971-bd4e58131240 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da4977cf-f3d5-4c25-873c-06e8479171e3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:23 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da4977cf-f3d5-4c25-873c-06e8479171e3 Jul 14 13:14:23 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:23 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-82903cb3-dc2a-4da3-b971-bd4e58131240 tempest-TestServerVolumeAttachmentScenario-1615696183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da4977cf-f3d5-4c25-873c-06e8479171e3" returned: 0 in 0.351s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-82903cb3-dc2a-4da3-b971-bd4e58131240 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da4977cf-f3d5-4c25-873c-06e8479171e3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:23 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da4977cf-f3d5-4c25-873c-06e8479171e3 Jul 14 13:14:23 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:23 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-82903cb3-dc2a-4da3-b971-bd4e58131240 tempest-TestServerVolumeAttachmentScenario-1615696183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-da4977cf-f3d5-4c25-873c-06e8479171e3" returned: 0 in 0.254s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-82903cb3-dc2a-4da3-b971-bd4e58131240 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "cinder-quobyte-da4977cf-f3d5-4c25-873c-06e8479171e3" released by "delete_volume" :: held 0.643s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:14:23 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-82903cb3-dc2a-4da3-b971-bd4e58131240 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Created reservations ['d2972c11-58c1-42b3-9608-b6ccb95246fa', '5627ece1-ef37-4044-87a1-7b1f4564fce7', '54b96116-75ad-4efa-bb29-ece0e4bf94cc', 'f0aee721-a594-4ab6-9fd9-70fa05e4beef'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:14:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-82903cb3-dc2a-4da3-b971-bd4e58131240 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:14:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-82903cb3-dc2a-4da3-b971-bd4e58131240 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:14:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-82903cb3-dc2a-4da3-b971-bd4e58131240 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:14:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-82903cb3-dc2a-4da3-b971-bd4e58131240 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:14:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-82903cb3-dc2a-4da3-b971-bd4e58131240 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:14:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-82903cb3-dc2a-4da3-b971-bd4e58131240 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:23 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:14:23 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:23 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-82903cb3-dc2a-4da3-b971-bd4e58131240 tempest-TestServerVolumeAttachmentScenario-1615696183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.246s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:23 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-82903cb3-dc2a-4da3-b971-bd4e58131240 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:14:23 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-82903cb3-dc2a-4da3-b971-bd4e58131240 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Deleted volume successfully. Jul 14 13:14:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-82903cb3-dc2a-4da3-b971-bd4e58131240 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "cinder-da4977cf-f3d5-4c25-873c-06e8479171e3-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:14:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-afaba12d-e098-4c3d-b3c6-a01f5c2758a0 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Acquiring lock "cinder-daba5b97-ed53-4017-abc1-6dde035676e3-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:14:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-afaba12d-e098-4c3d-b3c6-a01f5c2758a0 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "cinder-daba5b97-ed53-4017-abc1-6dde035676e3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:14:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-afaba12d-e098-4c3d-b3c6-a01f5c2758a0 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Acquiring lock "cinder-quobyte-daba5b97-ed53-4017-abc1-6dde035676e3" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:14:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-afaba12d-e098-4c3d-b3c6-a01f5c2758a0 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "cinder-quobyte-daba5b97-ed53-4017-abc1-6dde035676e3" acquired by "delete_volume" :: waited 0.013s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:14:24 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[675777d9-e25c-4ec9-b186-0a4d920bd415]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:14:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-afaba12d-e098-4c3d-b3c6-a01f5c2758a0 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-daba5b97-ed53-4017-abc1-6dde035676e3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:24 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-daba5b97-ed53-4017-abc1-6dde035676e3 Jul 14 13:14:24 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:24 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-afaba12d-e098-4c3d-b3c6-a01f5c2758a0 tempest-TestServerVolumeAttachmentScenario-1615696183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-daba5b97-ed53-4017-abc1-6dde035676e3" returned: 0 in 0.358s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-afaba12d-e098-4c3d-b3c6-a01f5c2758a0 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-daba5b97-ed53-4017-abc1-6dde035676e3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:24 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-daba5b97-ed53-4017-abc1-6dde035676e3 Jul 14 13:14:24 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:24 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-afaba12d-e098-4c3d-b3c6-a01f5c2758a0 tempest-TestServerVolumeAttachmentScenario-1615696183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-daba5b97-ed53-4017-abc1-6dde035676e3" returned: 0 in 0.270s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-afaba12d-e098-4c3d-b3c6-a01f5c2758a0 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "cinder-quobyte-daba5b97-ed53-4017-abc1-6dde035676e3" released by "delete_volume" :: held 0.666s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:14:24 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-afaba12d-e098-4c3d-b3c6-a01f5c2758a0 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Created reservations ['514f1e3b-5715-4056-9984-a76a910b24c7', '3caf0976-708b-40bb-9824-cc6a2e433654', '742f207d-925f-4527-9d2c-bcc77c16256f', '4ec94ab3-51ce-4124-87e1-3d13e857c572'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:14:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-afaba12d-e098-4c3d-b3c6-a01f5c2758a0 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:14:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-afaba12d-e098-4c3d-b3c6-a01f5c2758a0 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:14:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-afaba12d-e098-4c3d-b3c6-a01f5c2758a0 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:14:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-afaba12d-e098-4c3d-b3c6-a01f5c2758a0 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:14:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-afaba12d-e098-4c3d-b3c6-a01f5c2758a0 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:14:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-afaba12d-e098-4c3d-b3c6-a01f5c2758a0 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:24 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:14:24 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:25 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-afaba12d-e098-4c3d-b3c6-a01f5c2758a0 tempest-TestServerVolumeAttachmentScenario-1615696183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.246s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:25 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-afaba12d-e098-4c3d-b3c6-a01f5c2758a0 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:14:25 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-afaba12d-e098-4c3d-b3c6-a01f5c2758a0 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Deleted volume successfully. Jul 14 13:14:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-afaba12d-e098-4c3d-b3c6-a01f5c2758a0 tempest-TestServerVolumeAttachmentScenario-1615696183 None] Lock "cinder-daba5b97-ed53-4017-abc1-6dde035676e3-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:14:34 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:14:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Flow 'volume_create_manager' (9134df0b-c498-4983-aa7e-fdd9e3362d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:14:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca544c7c-0f62-47d9-98cc-4c9f2494cd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:14:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca544c7c-0f62-47d9-98cc-4c9f2494cd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1978955394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167bda43-9634-4a5e-a1be-af21e635cdd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d77dd8024bb9430eb14078f176d6fe8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:14:35Z,use_quota=True,user_id='ad84bac1eabc4f5ca0a71abede3b03d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:14:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e10ba5-aadb-4730-924f-41bf345316b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:14:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e10ba5-aadb-4730-924f-41bf345316b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:14:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0477b6f0-50ab-4cdf-870f-48c2fff4b014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:14:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0477b6f0-50ab-4cdf-870f-48c2fff4b014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '167bda43-9634-4a5e-a1be-af21e635cdd8', 'volume_name': 'volume-167bda43-9634-4a5e-a1be-af21e635cdd8', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:14:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d87e41-2527-49ec-b6ec-206d90de086d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:14:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d87e41-2527-49ec-b6ec-206d90de086d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:14:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db265863-c769-47f5-8b0b-3ea92f2a18be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:14:34 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Volume 167bda43-9634-4a5e-a1be-af21e635cdd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-167bda43-9634-4a5e-a1be-af21e635cdd8', 'volume_size': 1} Jul 14 13:14:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:14:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:14:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1978955394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167bda43-9634-4a5e-a1be-af21e635cdd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d77dd8024bb9430eb14078f176d6fe8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:14:35Z,use_quota=True,user_id='ad84bac1eabc4f5ca0a71abede3b03d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:14:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Creating volume 167bda43-9634-4a5e-a1be-af21e635cdd8 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:14:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:14:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:14:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:14:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:14:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:14:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:14:34 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:14:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:34 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8 1073741824 Jul 14 13:14:34 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:35 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8 1073741824" returned: 0 in 0.401s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:35 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8 Jul 14 13:14:35 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:35 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8" returned: 0 in 0.257s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:14:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:14:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db265863-c769-47f5-8b0b-3ea92f2a18be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-167bda43-9634-4a5e-a1be-af21e635cdd8', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:14:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b8bc78-51ca-44f4-bd43-87f625fe9dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:14:35 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Volume volume-167bda43-9634-4a5e-a1be-af21e635cdd8 (167bda43-9634-4a5e-a1be-af21e635cdd8): created successfully Jul 14 13:14:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b8bc78-51ca-44f4-bd43-87f625fe9dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:14:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Flow 'volume_create_manager' (9134df0b-c498-4983-aa7e-fdd9e3362d9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:14:35 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-0c09e0b0-1d92-449c-a4bb-acb8566d7a0e tempest-VolumeDependencyTests-2059115056 None] Created volume successfully. Jul 14 13:14:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d91f71ce-779c-4d4a-a435-cc2463bb6fad tempest-VolumeDependencyTests-2059115056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:14:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d91f71ce-779c-4d4a-a435-cc2463bb6fad tempest-VolumeDependencyTests-2059115056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:14:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-d91f71ce-779c-4d4a-a435-cc2463bb6fad tempest-VolumeDependencyTests-2059115056 None] Creating offline snapshot a0e4e6e6-fb2b-4bce-bba0-333e9bea0393 of volume 167bda43-9634-4a5e-a1be-af21e635cdd8 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:14:35 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b54781c-9688-43b6-8b9a-c9b839299ab4]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:14:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d91f71ce-779c-4d4a-a435-cc2463bb6fad tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:35 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8 Jul 14 13:14:35 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:36 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d91f71ce-779c-4d4a-a435-cc2463bb6fad tempest-VolumeDependencyTests-2059115056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8" returned: 0 in 0.353s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d91f71ce-779c-4d4a-a435-cc2463bb6fad tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:36 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393 1G Jul 14 13:14:36 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:36 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d91f71ce-779c-4d4a-a435-cc2463bb6fad tempest-VolumeDependencyTests-2059115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393 1G" returned: 0 in 0.394s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d91f71ce-779c-4d4a-a435-cc2463bb6fad tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-167bda43-9634-4a5e-a1be-af21e635cdd8 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:36 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-167bda43-9634-4a5e-a1be-af21e635cdd8 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393 Jul 14 13:14:36 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:36 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d91f71ce-779c-4d4a-a435-cc2463bb6fad tempest-VolumeDependencyTests-2059115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-167bda43-9634-4a5e-a1be-af21e635cdd8 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393" returned: 0 in 0.281s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:36 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-d91f71ce-779c-4d4a-a435-cc2463bb6fad tempest-VolumeDependencyTests-2059115056 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393 is being set with open permissions: ugo+rw Jul 14 13:14:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d91f71ce-779c-4d4a-a435-cc2463bb6fad tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:36 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393 Jul 14 13:14:36 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:37 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d91f71ce-779c-4d4a-a435-cc2463bb6fad tempest-VolumeDependencyTests-2059115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393" returned: 0 in 0.246s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d91f71ce-779c-4d4a-a435-cc2463bb6fad tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:37 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.info Jul 14 13:14:37 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:37 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d91f71ce-779c-4d4a-a435-cc2463bb6fad tempest-VolumeDependencyTests-2059115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.info" returned: 0 in 0.254s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:37 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-d91f71ce-779c-4d4a-a435-cc2463bb6fad tempest-VolumeDependencyTests-2059115056 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.info is being set with open permissions: ugo+rw Jul 14 13:14:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d91f71ce-779c-4d4a-a435-cc2463bb6fad tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:37 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.info Jul 14 13:14:37 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:37 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d91f71ce-779c-4d4a-a435-cc2463bb6fad tempest-VolumeDependencyTests-2059115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.info" returned: 0 in 0.244s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d91f71ce-779c-4d4a-a435-cc2463bb6fad tempest-VolumeDependencyTests-2059115056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.852s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:14:37 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-d91f71ce-779c-4d4a-a435-cc2463bb6fad tempest-VolumeDependencyTests-2059115056 None] Create snapshot completed successfully Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Flow 'volume_create_manager' (402cd51e-3ba8-430e-8072-59af18c6da30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e69d26-2fcd-45c1-9252-e8ae5b1a9be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e69d26-2fcd-45c1-9252-e8ae5b1a9be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1836911886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afae2659-ce58-4074-b4f4-0608657f78f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d77dd8024bb9430eb14078f176d6fe8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a0e4e6e6-fb2b-4bce-bba0-333e9bea0393,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:14:38Z,use_quota=True,user_id='ad84bac1eabc4f5ca0a71abede3b03d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f9d072-9b02-4d72-a342-512521d9912c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f9d072-9b02-4d72-a342-512521d9912c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (499635fd-132c-44e2-8f20-51fe183d684c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (499635fd-132c-44e2-8f20-51fe183d684c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'afae2659-ce58-4074-b4f4-0608657f78f1', 'volume_name': 'volume-afae2659-ce58-4074-b4f4-0608657f78f1', 'volume_size': 1, 'snapshot_id': 'a0e4e6e6-fb2b-4bce-bba0-333e9bea0393'}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef04012-7444-4b93-a580-171f863d6581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef04012-7444-4b93-a580-171f863d6581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abc2df8-12a6-4924-a42d-6bdcedf80f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:14:38 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Volume afae2659-ce58-4074-b4f4-0608657f78f1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-afae2659-ce58-4074-b4f4-0608657f78f1', 'volume_size': 1, 'snapshot_id': 'a0e4e6e6-fb2b-4bce-bba0-333e9bea0393'} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Acquiring lock "cinder-quobyte-a0e4e6e6-fb2b-4bce-bba0-333e9bea0393-afae2659-ce58-4074-b4f4-0608657f78f1" by "_create_volume_from_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Lock "cinder-quobyte-a0e4e6e6-fb2b-4bce-bba0-333e9bea0393-afae2659-ce58-4074-b4f4-0608657f78f1" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Creating volume afae2659-ce58-4074-b4f4-0608657f78f1 from snapshot a0e4e6e6-fb2b-4bce-bba0-333e9bea0393 {{(pid=86977) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Acquiring lock "cinder-quobyte-afae2659-ce58-4074-b4f4-0608657f78f1" by "_copy_volume_from_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Lock "cinder-quobyte-afae2659-ce58-4074-b4f4-0608657f78f1" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] snapshot: a0e4e6e6-fb2b-4bce-bba0-333e9bea0393, volume: afae2659-ce58-4074-b4f4-0608657f78f1, {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a1d34a-1a49-41af-8453-834b59669c50]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:38 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393 Jul 14 13:14:38 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:38 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393" returned: 0 in 0.356s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-167bda43-9634-4a5e-a1be-af21e635cdd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8 {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Creating direct copy from snapshot {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[6733c28b-14f8-4a79-91c7-49cf2e555de4]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:14:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:39 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8 Jul 14 13:14:39 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:39 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8" returned: 0 in 0.353s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:39 devstack cinder-volume[86977]: DEBUG cinder.utils [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Path /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-afae2659-ce58-4074-b4f4-0608657f78f1 not found in is_blk_device check {{(pid=86977) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 13:14:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-afae2659-ce58-4074-b4f4-0608657f78f1 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:39 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-afae2659-ce58-4074-b4f4-0608657f78f1 Jul 14 13:14:39 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:43 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-afae2659-ce58-4074-b4f4-0608657f78f1" returned: 0 in 4.075s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:43 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c785f0-1c18-4d9e-8fe5-ac2e3699b133]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:14:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:43 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8 Jul 14 13:14:43 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:43 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8" returned: 0 in 0.527s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:43 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Image conversion details: src /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8, size 1024.00 MB, duration 4.08 sec, destination /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-afae2659-ce58-4074-b4f4-0608657f78f1 {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:14:43 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Converted 1024.00 MB image at 251.20 MB/s Jul 14 13:14:43 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-afae2659-ce58-4074-b4f4-0608657f78f1 is being set with open permissions: ugo+rw Jul 14 13:14:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-afae2659-ce58-4074-b4f4-0608657f78f1 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:43 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-afae2659-ce58-4074-b4f4-0608657f78f1 Jul 14 13:14:43 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:44 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-afae2659-ce58-4074-b4f4-0608657f78f1" returned: 0 in 0.237s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:44 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Lock "cinder-quobyte-afae2659-ce58-4074-b4f4-0608657f78f1" released by "_copy_volume_from_snapshot" :: held 5.642s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:14:44 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Lock "cinder-quobyte-a0e4e6e6-fb2b-4bce-bba0-333e9bea0393-afae2659-ce58-4074-b4f4-0608657f78f1" released by "_create_volume_from_snapshot" :: held 5.669s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:14:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.685s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:14:44 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abc2df8-12a6-4924-a42d-6bdcedf80f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afae2659-ce58-4074-b4f4-0608657f78f1', 'volume_size': 1, 'snapshot_id': 'a0e4e6e6-fb2b-4bce-bba0-333e9bea0393'}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:14:44 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e87e257-34a6-4575-bde5-e45e0a9c6351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:14:44 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Volume volume-afae2659-ce58-4074-b4f4-0608657f78f1 (afae2659-ce58-4074-b4f4-0608657f78f1): created successfully Jul 14 13:14:44 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e87e257-34a6-4575-bde5-e45e0a9c6351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:14:44 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Flow 'volume_create_manager' (402cd51e-3ba8-430e-8072-59af18c6da30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:14:44 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-4a516dd2-11e6-4574-8b64-1463de988326 tempest-VolumeDependencyTests-2059115056 None] Created volume successfully. Jul 14 13:14:44 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0dc2c14f-e661-4654-bf4e-7e6239810d6a tempest-VolumeDependencyTests-2059115056 None] Acquiring lock "cinder-a0e4e6e6-fb2b-4bce-bba0-333e9bea0393-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:14:44 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0dc2c14f-e661-4654-bf4e-7e6239810d6a tempest-VolumeDependencyTests-2059115056 None] Lock "cinder-a0e4e6e6-fb2b-4bce-bba0-333e9bea0393-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:14:44 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0dc2c14f-e661-4654-bf4e-7e6239810d6a tempest-VolumeDependencyTests-2059115056 None] Acquiring lock "cinder-quobyte-167bda43-9634-4a5e-a1be-af21e635cdd8" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:14:44 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0dc2c14f-e661-4654-bf4e-7e6239810d6a tempest-VolumeDependencyTests-2059115056 None] Lock "cinder-quobyte-167bda43-9634-4a5e-a1be-af21e635cdd8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:14:44 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0dc2c14f-e661-4654-bf4e-7e6239810d6a tempest-VolumeDependencyTests-2059115056 None] Acquiring lock "cinder-quobyte-a0e4e6e6-fb2b-4bce-bba0-333e9bea0393" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:14:44 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0dc2c14f-e661-4654-bf4e-7e6239810d6a tempest-VolumeDependencyTests-2059115056 None] Lock "cinder-quobyte-a0e4e6e6-fb2b-4bce-bba0-333e9bea0393" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:14:44 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-0dc2c14f-e661-4654-bf4e-7e6239810d6a tempest-VolumeDependencyTests-2059115056 None] Deleting offline snapshot a0e4e6e6-fb2b-4bce-bba0-333e9bea0393 of volume 167bda43-9634-4a5e-a1be-af21e635cdd8 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:14:45 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-0dc2c14f-e661-4654-bf4e-7e6239810d6a tempest-VolumeDependencyTests-2059115056 None] snapshot_file for this snap is: volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:14:45 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[96aa9026-3460-4863-86bc-f16a9e6a8a64]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:14:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0dc2c14f-e661-4654-bf4e-7e6239810d6a tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:45 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393 Jul 14 13:14:45 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:45 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0dc2c14f-e661-4654-bf4e-7e6239810d6a tempest-VolumeDependencyTests-2059115056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393" returned: 0 in 0.348s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:45 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-0dc2c14f-e661-4654-bf4e-7e6239810d6a tempest-VolumeDependencyTests-2059115056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-167bda43-9634-4a5e-a1be-af21e635cdd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:14:45 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[4739e0a5-5c69-4bc8-9e0d-a8f92bfa8687]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:14:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0dc2c14f-e661-4654-bf4e-7e6239810d6a tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:45 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8 Jul 14 13:14:45 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:45 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0dc2c14f-e661-4654-bf4e-7e6239810d6a tempest-VolumeDependencyTests-2059115056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8" returned: 0 in 0.358s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0dc2c14f-e661-4654-bf4e-7e6239810d6a tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:45 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393 Jul 14 13:14:45 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:46 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0dc2c14f-e661-4654-bf4e-7e6239810d6a tempest-VolumeDependencyTests-2059115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393" returned: 0 in 0.332s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0dc2c14f-e661-4654-bf4e-7e6239810d6a tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:46 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393 Jul 14 13:14:46 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:46 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0dc2c14f-e661-4654-bf4e-7e6239810d6a tempest-VolumeDependencyTests-2059115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8.a0e4e6e6-fb2b-4bce-bba0-333e9bea0393" returned: 0 in 0.239s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:46 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0dc2c14f-e661-4654-bf4e-7e6239810d6a tempest-VolumeDependencyTests-2059115056 None] Lock "cinder-quobyte-a0e4e6e6-fb2b-4bce-bba0-333e9bea0393" released by "_delete_snapshot" :: held 1.369s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:14:46 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0dc2c14f-e661-4654-bf4e-7e6239810d6a tempest-VolumeDependencyTests-2059115056 None] Lock "cinder-quobyte-167bda43-9634-4a5e-a1be-af21e635cdd8" released by "delete_snapshot" :: held 1.394s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:14:46 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-0dc2c14f-e661-4654-bf4e-7e6239810d6a tempest-VolumeDependencyTests-2059115056 None] Created reservations ['fdf953d5-d4ec-4250-acec-6c7f1eb394ad', '303b2e57-ac3c-435b-9be2-cd9640e7cced', '2c9ae354-1c7f-441a-b042-ac51951ca4bb', '07da1912-57e1-4ae2-82c0-8836579413b5'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:14:46 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-0dc2c14f-e661-4654-bf4e-7e6239810d6a tempest-VolumeDependencyTests-2059115056 None] Delete snapshot completed successfully. Jul 14 13:14:46 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0dc2c14f-e661-4654-bf4e-7e6239810d6a tempest-VolumeDependencyTests-2059115056 None] Lock "cinder-a0e4e6e6-fb2b-4bce-bba0-333e9bea0393-delete_snapshot" released by "delete_snapshot" :: held 1.525s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:14:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1402b538-b676-4fed-8cb5-89c42504b13b tempest-VolumeDependencyTests-2059115056 None] Acquiring lock "cinder-167bda43-9634-4a5e-a1be-af21e635cdd8-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:14:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1402b538-b676-4fed-8cb5-89c42504b13b tempest-VolumeDependencyTests-2059115056 None] Lock "cinder-167bda43-9634-4a5e-a1be-af21e635cdd8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:14:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1402b538-b676-4fed-8cb5-89c42504b13b tempest-VolumeDependencyTests-2059115056 None] Acquiring lock "cinder-quobyte-167bda43-9634-4a5e-a1be-af21e635cdd8" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:14:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1402b538-b676-4fed-8cb5-89c42504b13b tempest-VolumeDependencyTests-2059115056 None] Lock "cinder-quobyte-167bda43-9634-4a5e-a1be-af21e635cdd8" acquired by "delete_volume" :: waited 0.014s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:14:47 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[0661e151-a9d3-45f2-8839-c4957da85a87]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:14:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1402b538-b676-4fed-8cb5-89c42504b13b tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:47 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8 Jul 14 13:14:47 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:47 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1402b538-b676-4fed-8cb5-89c42504b13b tempest-VolumeDependencyTests-2059115056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8" returned: 0 in 0.358s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1402b538-b676-4fed-8cb5-89c42504b13b tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:47 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8 Jul 14 13:14:47 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:47 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1402b538-b676-4fed-8cb5-89c42504b13b tempest-VolumeDependencyTests-2059115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-167bda43-9634-4a5e-a1be-af21e635cdd8" returned: 0 in 0.254s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1402b538-b676-4fed-8cb5-89c42504b13b tempest-VolumeDependencyTests-2059115056 None] Lock "cinder-quobyte-167bda43-9634-4a5e-a1be-af21e635cdd8" released by "delete_volume" :: held 0.668s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:14:47 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-1402b538-b676-4fed-8cb5-89c42504b13b tempest-VolumeDependencyTests-2059115056 None] Created reservations ['2ce05698-c374-4ecb-abcc-c6c7e9824094', 'd7f0bada-1f08-4b17-aa3e-1b523e53ab56', 'b96e425f-1cae-491d-a833-2b3a5756fa07', 'c921b9c2-dfe9-4ffb-a091-e14186559a10'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:14:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1402b538-b676-4fed-8cb5-89c42504b13b tempest-VolumeDependencyTests-2059115056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:14:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1402b538-b676-4fed-8cb5-89c42504b13b tempest-VolumeDependencyTests-2059115056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:14:47 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1402b538-b676-4fed-8cb5-89c42504b13b tempest-VolumeDependencyTests-2059115056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:14:47 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1402b538-b676-4fed-8cb5-89c42504b13b tempest-VolumeDependencyTests-2059115056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:14:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1402b538-b676-4fed-8cb5-89c42504b13b tempest-VolumeDependencyTests-2059115056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:14:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1402b538-b676-4fed-8cb5-89c42504b13b tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:47 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:14:47 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:48 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1402b538-b676-4fed-8cb5-89c42504b13b tempest-VolumeDependencyTests-2059115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.247s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:48 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-1402b538-b676-4fed-8cb5-89c42504b13b tempest-VolumeDependencyTests-2059115056 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:14:48 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-1402b538-b676-4fed-8cb5-89c42504b13b tempest-VolumeDependencyTests-2059115056 None] Deleted volume successfully. Jul 14 13:14:48 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1402b538-b676-4fed-8cb5-89c42504b13b tempest-VolumeDependencyTests-2059115056 None] Lock "cinder-167bda43-9634-4a5e-a1be-af21e635cdd8-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:14:48 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3f7e7f73-a89e-4f92-86ba-c0dba9f7fb91 tempest-VolumeDependencyTests-2059115056 None] Acquiring lock "cinder-afae2659-ce58-4074-b4f4-0608657f78f1-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:14:48 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3f7e7f73-a89e-4f92-86ba-c0dba9f7fb91 tempest-VolumeDependencyTests-2059115056 None] Lock "cinder-afae2659-ce58-4074-b4f4-0608657f78f1-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:14:48 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3f7e7f73-a89e-4f92-86ba-c0dba9f7fb91 tempest-VolumeDependencyTests-2059115056 None] Acquiring lock "cinder-quobyte-afae2659-ce58-4074-b4f4-0608657f78f1" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:14:48 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3f7e7f73-a89e-4f92-86ba-c0dba9f7fb91 tempest-VolumeDependencyTests-2059115056 None] Lock "cinder-quobyte-afae2659-ce58-4074-b4f4-0608657f78f1" acquired by "delete_volume" :: waited 0.014s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:14:48 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[70399b22-cb50-4724-9a24-40e726f1e58c]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:14:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3f7e7f73-a89e-4f92-86ba-c0dba9f7fb91 tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-afae2659-ce58-4074-b4f4-0608657f78f1 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:48 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-afae2659-ce58-4074-b4f4-0608657f78f1 Jul 14 13:14:48 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:48 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3f7e7f73-a89e-4f92-86ba-c0dba9f7fb91 tempest-VolumeDependencyTests-2059115056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-afae2659-ce58-4074-b4f4-0608657f78f1" returned: 0 in 0.375s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3f7e7f73-a89e-4f92-86ba-c0dba9f7fb91 tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-afae2659-ce58-4074-b4f4-0608657f78f1 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:48 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-afae2659-ce58-4074-b4f4-0608657f78f1 Jul 14 13:14:48 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:48 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3f7e7f73-a89e-4f92-86ba-c0dba9f7fb91 tempest-VolumeDependencyTests-2059115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-afae2659-ce58-4074-b4f4-0608657f78f1" returned: 0 in 0.244s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:48 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3f7e7f73-a89e-4f92-86ba-c0dba9f7fb91 tempest-VolumeDependencyTests-2059115056 None] Lock "cinder-quobyte-afae2659-ce58-4074-b4f4-0608657f78f1" released by "delete_volume" :: held 0.661s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:14:49 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-3f7e7f73-a89e-4f92-86ba-c0dba9f7fb91 tempest-VolumeDependencyTests-2059115056 None] Created reservations ['1f02f75d-14eb-4f05-be5d-c6e1888762db', 'c529cf0e-29bc-4c62-a7ff-bccc7934ddc7', '57ae5c47-df61-4be0-ae57-b2831a16c3e4', 'cf032936-389b-447f-ac00-805674e99d98'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:14:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3f7e7f73-a89e-4f92-86ba-c0dba9f7fb91 tempest-VolumeDependencyTests-2059115056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:14:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3f7e7f73-a89e-4f92-86ba-c0dba9f7fb91 tempest-VolumeDependencyTests-2059115056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:14:49 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3f7e7f73-a89e-4f92-86ba-c0dba9f7fb91 tempest-VolumeDependencyTests-2059115056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:14:49 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3f7e7f73-a89e-4f92-86ba-c0dba9f7fb91 tempest-VolumeDependencyTests-2059115056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:14:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3f7e7f73-a89e-4f92-86ba-c0dba9f7fb91 tempest-VolumeDependencyTests-2059115056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:14:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3f7e7f73-a89e-4f92-86ba-c0dba9f7fb91 tempest-VolumeDependencyTests-2059115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:14:49 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:14:49 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:14:49 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 14 13:14:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3f7e7f73-a89e-4f92-86ba-c0dba9f7fb91 tempest-VolumeDependencyTests-2059115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.234s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:14:49 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-3f7e7f73-a89e-4f92-86ba-c0dba9f7fb91 tempest-VolumeDependencyTests-2059115056 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:14:49 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-3f7e7f73-a89e-4f92-86ba-c0dba9f7fb91 tempest-VolumeDependencyTests-2059115056 None] Deleted volume successfully. Jul 14 13:14:49 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3f7e7f73-a89e-4f92-86ba-c0dba9f7fb91 tempest-VolumeDependencyTests-2059115056 None] Lock "cinder-afae2659-ce58-4074-b4f4-0608657f78f1-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:14:59 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=55,cinder:UPDATE=47,cinder:INSERT=12,cinder:DELETE=2 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:14:59 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=39,cinder:UPDATE=48,cinder:INSERT=10,cinder:DELETE=5 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Flow 'volume_create_manager' (0bdf6432-591d-4027-bbe9-0f440170a686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a26ce6b-aed6-484d-bde8-249b7289e016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a26ce6b-aed6-484d-bde8-249b7289e016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-339623816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e90439a9fe8f4c168ce63d7cc37482a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:01Z,use_quota=True,user_id='d8e42126b84c4fe5b9273cc120315fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347a3ce6-bfcc-4c34-9066-0c0d6d5afb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347a3ce6-bfcc-4c34-9066-0c0d6d5afb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8702c4-a85b-4f50-b131-e4c055b58800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8702c4-a85b-4f50-b131-e4c055b58800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b', 'volume_name': 'volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512abeaf-8a20-4f3e-9832-993e2a24de9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512abeaf-8a20-4f3e-9832-993e2a24de9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ddcf62c-a25e-4f55-855c-4ddfb86b5330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:01 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Volume 8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b', 'volume_size': 1} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-339623816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e90439a9fe8f4c168ce63d7cc37482a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:01Z,use_quota=True,user_id='d8e42126b84c4fe5b9273cc120315fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Creating volume 8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:01 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Flow 'volume_create_manager' (c175341b-adea-450a-be6e-e5cf14c8070a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2199b89f-5bfd-4b64-94af-cc6cc8e39332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:01 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b 1073741824 Jul 14 13:15:01 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2199b89f-5bfd-4b64-94af-cc6cc8e39332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1510706882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb8456d-a30b-4d8e-a1c7-3464cad8182a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa47863a19294b4ca2cb1b707a233386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:01Z,use_quota=True,user_id='3e8e36c751be4b2ebfd42e7852432785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (072a59f9-8dec-496a-960d-e1e0f85a0b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (072a59f9-8dec-496a-960d-e1e0f85a0b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b20f69-3c5c-4864-aa0b-14924410e338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b20f69-3c5c-4864-aa0b-14924410e338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfb8456d-a30b-4d8e-a1c7-3464cad8182a', 'volume_name': 'volume-dfb8456d-a30b-4d8e-a1c7-3464cad8182a', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc01bc1c-764d-4114-9a95-03378877a703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc01bc1c-764d-4114-9a95-03378877a703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edfb8f8e-14e8-4e52-9240-4f2df09e9599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:01 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Volume dfb8456d-a30b-4d8e-a1c7-3464cad8182a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfb8456d-a30b-4d8e-a1c7-3464cad8182a', 'volume_size': 1} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Flow 'volume_create_manager' (9f9252ea-61db-48c2-bc64-70ab9c233b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e78aa26-5bf9-4d43-a8d7-5170bd362615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e78aa26-5bf9-4d43-a8d7-5170bd362615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-629458673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce5fab1-fdd9-480b-a9eb-8d2be92393d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='861a31ded75946e09a160f4399903eab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:02Z,use_quota=True,user_id='b8635997ab6e428998f4dc06f1d96b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a5b10f-c355-4e5b-9bf3-a2c9bdc2e776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a5b10f-c355-4e5b-9bf3-a2c9bdc2e776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d882e424-e8c9-43ec-9793-644fe9a0ab29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d882e424-e8c9-43ec-9793-644fe9a0ab29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ce5fab1-fdd9-480b-a9eb-8d2be92393d5', 'volume_name': 'volume-6ce5fab1-fdd9-480b-a9eb-8d2be92393d5', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f8ae3fb-91b0-47db-8af6-4a599b0a6fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f8ae3fb-91b0-47db-8af6-4a599b0a6fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1c9a27-3e79-45f3-8a14-e083c94ae7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:01 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Volume 6ce5fab1-fdd9-480b-a9eb-8d2be92393d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ce5fab1-fdd9-480b-a9eb-8d2be92393d5', 'volume_size': 1} Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:01 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b 1073741824" returned: 0 in 0.613s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:02 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b Jul 14 13:15:02 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Flow 'volume_create_manager' (136287ab-575f-4eb9-828e-1a058175569f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b700f16e-8b63-4a92-bfc9-493bbbdddef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b700f16e-8b63-4a92-bfc9-493bbbdddef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1305109492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90452194-919d-49b3-8ed7-881b762f7c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='861a31ded75946e09a160f4399903eab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:02Z,use_quota=True,user_id='b8635997ab6e428998f4dc06f1d96b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed6ca0d-c894-40da-aaad-594380707dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed6ca0d-c894-40da-aaad-594380707dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15ba19d-8af0-4147-b8ab-7c846c34c7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15ba19d-8af0-4147-b8ab-7c846c34c7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90452194-919d-49b3-8ed7-881b762f7c04', 'volume_name': 'volume-90452194-919d-49b3-8ed7-881b762f7c04', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd81ff51-fb21-4657-8a34-4780538233bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd81ff51-fb21-4657-8a34-4780538233bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a6a5eb-f3d0-4655-95e1-9ba8a4794d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:02 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Volume 90452194-919d-49b3-8ed7-881b762f7c04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90452194-919d-49b3-8ed7-881b762f7c04', 'volume_size': 1} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:02 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b" returned: 0 in 0.275s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.767s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1510706882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb8456d-a30b-4d8e-a1c7-3464cad8182a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa47863a19294b4ca2cb1b707a233386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:01Z,use_quota=True,user_id='3e8e36c751be4b2ebfd42e7852432785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Creating volume dfb8456d-a30b-4d8e-a1c7-3464cad8182a {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:02 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfb8456d-a30b-4d8e-a1c7-3464cad8182a 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:02 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfb8456d-a30b-4d8e-a1c7-3464cad8182a 1073741824 Jul 14 13:15:02 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ddcf62c-a25e-4f55-855c-4ddfb86b5330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414cba5e-f744-4914-b197-dfc3a9fc0a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:02 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Volume volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b (8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b): created successfully Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414cba5e-f744-4914-b197-dfc3a9fc0a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Flow 'volume_create_manager' (0bdf6432-591d-4027-bbe9-0f440170a686) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:02 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-759fd40d-ac9a-44ad-9ec0-dafaa06bdaf7 tempest-CreateVolumesFromSnapshotTest-969137350 None] Created volume successfully. Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Flow 'volume_create_manager' (98a07fc5-f3f3-413f-82d2-ab34a7ee86d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eff7e45-169b-4c20-a477-845622e41679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eff7e45-169b-4c20-a477-845622e41679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1576138285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5007647c-bab4-476e-a11b-e2f9d384b2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='861a31ded75946e09a160f4399903eab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:03Z,use_quota=True,user_id='b8635997ab6e428998f4dc06f1d96b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3838b42-ce8f-4ef4-b2f1-1e4e3dbf2b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3838b42-ce8f-4ef4-b2f1-1e4e3dbf2b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec881148-1f18-4287-84eb-629773fd360f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec881148-1f18-4287-84eb-629773fd360f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5007647c-bab4-476e-a11b-e2f9d384b2c1', 'volume_name': 'volume-5007647c-bab4-476e-a11b-e2f9d384b2c1', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8991dde0-38d5-487a-a734-65222f0f5fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8991dde0-38d5-487a-a734-65222f0f5fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dac6a68-e7a1-42ae-bf7f-9f19aa036bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:02 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Volume 5007647c-bab4-476e-a11b-e2f9d384b2c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5007647c-bab4-476e-a11b-e2f9d384b2c1', 'volume_size': 1} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfb8456d-a30b-4d8e-a1c7-3464cad8182a 1073741824" returned: 0 in 0.618s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:02 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfb8456d-a30b-4d8e-a1c7-3464cad8182a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:03 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfb8456d-a30b-4d8e-a1c7-3464cad8182a Jul 14 13:15:03 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Flow 'volume_create_manager' (c8c67866-bc8d-47d7-9470-55a3bf5f2b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4579f3ac-c7c1-4bf3-b310-daf556bb3b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4579f3ac-c7c1-4bf3-b310-daf556bb3b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-224941381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef8fb22-3713-469a-a894-9b06e29fcd34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='861a31ded75946e09a160f4399903eab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:03Z,use_quota=True,user_id='b8635997ab6e428998f4dc06f1d96b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf6041d-b71c-48ef-9df2-ef0f752b2705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf6041d-b71c-48ef-9df2-ef0f752b2705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12736809-8b84-430f-a10c-1255aa9d0851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12736809-8b84-430f-a10c-1255aa9d0851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ef8fb22-3713-469a-a894-9b06e29fcd34', 'volume_name': 'volume-3ef8fb22-3713-469a-a894-9b06e29fcd34', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7260eaf-2753-4e08-9cb1-812862243664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7260eaf-2753-4e08-9cb1-812862243664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cbc8aae-518a-4965-b9f3-dddbadaa05d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:03 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Volume 3ef8fb22-3713-469a-a894-9b06e29fcd34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ef8fb22-3713-469a-a894-9b06e29fcd34', 'volume_size': 1} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-eb181634-0730-4866-acd8-74ea14ba3834 tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:03 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfb8456d-a30b-4d8e-a1c7-3464cad8182a" returned: 0 in 0.405s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.622s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-629458673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce5fab1-fdd9-480b-a9eb-8d2be92393d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='861a31ded75946e09a160f4399903eab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:02Z,use_quota=True,user_id='b8635997ab6e428998f4dc06f1d96b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Creating volume 6ce5fab1-fdd9-480b-a9eb-8d2be92393d5 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:03 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ce5fab1-fdd9-480b-a9eb-8d2be92393d5 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edfb8f8e-14e8-4e52-9240-4f2df09e9599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfb8456d-a30b-4d8e-a1c7-3464cad8182a', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e420e1ac-4c6f-492e-8df2-26a2584ce281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:03 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ce5fab1-fdd9-480b-a9eb-8d2be92393d5 1073741824 Jul 14 13:15:03 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:03 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Volume volume-dfb8456d-a30b-4d8e-a1c7-3464cad8182a (dfb8456d-a30b-4d8e-a1c7-3464cad8182a): created successfully Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e420e1ac-4c6f-492e-8df2-26a2584ce281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Flow 'volume_create_manager' (c175341b-adea-450a-be6e-e5cf14c8070a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:03 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-95612b8c-134e-4374-8214-2a16b747b50d tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Created volume successfully. Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Flow 'volume_create_manager' (7064c3f1-c9c3-4280-b93f-a704d6de5962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e77ae61-7f8c-4378-9cc1-7c085637f90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e77ae61-7f8c-4378-9cc1-7c085637f90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-626664238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08aa5661-7354-4494-891d-4401df2e12d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='861a31ded75946e09a160f4399903eab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:04Z,use_quota=True,user_id='b8635997ab6e428998f4dc06f1d96b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c38118-84c3-4710-9eac-ca1f6641c691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c38118-84c3-4710-9eac-ca1f6641c691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c433780-d6ae-4864-8fc0-a95fffaa19c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c433780-d6ae-4864-8fc0-a95fffaa19c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08aa5661-7354-4494-891d-4401df2e12d0', 'volume_name': 'volume-08aa5661-7354-4494-891d-4401df2e12d0', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d887f7a2-af6c-4a6e-bba2-5b5ff42e5f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d887f7a2-af6c-4a6e-bba2-5b5ff42e5f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65acece-c51d-41ff-8c91-d30feebfee4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:03 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Volume 08aa5661-7354-4494-891d-4401df2e12d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08aa5661-7354-4494-891d-4401df2e12d0', 'volume_size': 1} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:03 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ce5fab1-fdd9-480b-a9eb-8d2be92393d5 1073741824" returned: 0 in 0.465s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ce5fab1-fdd9-480b-a9eb-8d2be92393d5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:03 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ce5fab1-fdd9-480b-a9eb-8d2be92393d5 Jul 14 13:15:03 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:04 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ce5fab1-fdd9-480b-a9eb-8d2be92393d5" returned: 0 in 0.278s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.973s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1305109492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90452194-919d-49b3-8ed7-881b762f7c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='861a31ded75946e09a160f4399903eab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:02Z,use_quota=True,user_id='b8635997ab6e428998f4dc06f1d96b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Creating volume 90452194-919d-49b3-8ed7-881b762f7c04 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:04 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-90452194-919d-49b3-8ed7-881b762f7c04 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1c9a27-3e79-45f3-8a14-e083c94ae7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce5fab1-fdd9-480b-a9eb-8d2be92393d5', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:04 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-90452194-919d-49b3-8ed7-881b762f7c04 1073741824 Jul 14 13:15:04 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4add4de-f9b1-40ae-b9df-7123e576ff82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:04 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Volume volume-6ce5fab1-fdd9-480b-a9eb-8d2be92393d5 (6ce5fab1-fdd9-480b-a9eb-8d2be92393d5): created successfully Jul 14 13:15:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4add4de-f9b1-40ae-b9df-7123e576ff82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Flow 'volume_create_manager' (9f9252ea-61db-48c2-bc64-70ab9c233b2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:04 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-00d79b29-dd56-4373-be3c-432b84cb5ed4 tempest-CreateVolumesFromImageTest-1320356657 None] Created volume successfully. Jul 14 13:15:04 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-90452194-919d-49b3-8ed7-881b762f7c04 1073741824" returned: 0 in 0.594s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-90452194-919d-49b3-8ed7-881b762f7c04 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:04 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-90452194-919d-49b3-8ed7-881b762f7c04 Jul 14 13:15:04 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:04 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Flow 'volume_create_manager' (859d91dc-62d0-449f-baff-7923740e873f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9a1a3c-c494-41e4-acad-7008ecab1efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9a1a3c-c494-41e4-acad-7008ecab1efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1833426540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=562ffe7e-843d-4f74-9ce7-6d52f9144314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa47863a19294b4ca2cb1b707a233386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:05Z,use_quota=True,user_id='3e8e36c751be4b2ebfd42e7852432785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f9a2b7-6b20-46aa-ad49-062af22215cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f9a2b7-6b20-46aa-ad49-062af22215cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff32bbc-e913-4608-ab56-d8effe6f6ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff32bbc-e913-4608-ab56-d8effe6f6ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '562ffe7e-843d-4f74-9ce7-6d52f9144314', 'volume_name': 'volume-562ffe7e-843d-4f74-9ce7-6d52f9144314', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac0130d-ac8e-4930-8e0c-4b3e8cec06b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac0130d-ac8e-4930-8e0c-4b3e8cec06b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708a2639-a277-4f34-9db2-b7c87165c80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:05 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Volume 562ffe7e-843d-4f74-9ce7-6d52f9144314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-562ffe7e-843d-4f74-9ce7-6d52f9144314', 'volume_size': 1} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:05 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-90452194-919d-49b3-8ed7-881b762f7c04" returned: 0 in 0.322s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.413s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1576138285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5007647c-bab4-476e-a11b-e2f9d384b2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='861a31ded75946e09a160f4399903eab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:03Z,use_quota=True,user_id='b8635997ab6e428998f4dc06f1d96b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Creating volume 5007647c-bab4-476e-a11b-e2f9d384b2c1 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:05 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5007647c-bab4-476e-a11b-e2f9d384b2c1 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:05 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5007647c-bab4-476e-a11b-e2f9d384b2c1 1073741824 Jul 14 13:15:05 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Flow 'volume_create_manager' (e39be2c7-ac97-468a-bc36-3586cbb1d6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce47b41-540c-4a5a-9ca0-e6a2ebc4d0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a6a5eb-f3d0-4655-95e1-9ba8a4794d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90452194-919d-49b3-8ed7-881b762f7c04', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63ac695-d306-4a27-98f0-55df17eb9f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce47b41-540c-4a5a-9ca0-e6a2ebc4d0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be32a5fc-31f5-478f-85fb-ab87d4b1e5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ab3fb59cbb444a883f500a93370a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:05Z,use_quota=True,user_id='ebb957e3f7a1469ca73222a79819ea41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(557695c1-5737-486b-8c84-59479309c18e),volume_type_id=557695c1-5737-486b-8c84-59479309c18e)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1006d0e-5421-49d5-a595-6a6f659df2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1006d0e-5421-49d5-a595-6a6f659df2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce4e7ddc-f9f7-4f5a-a9e1-359a20f3c1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.image.glance [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Creating Keystone auth plugin from conf {{(pid=86977) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Flow 'volume_create_manager' (80fca12a-7089-4b47-89b8-f7081c5b5d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe023ea-cd49-41d1-90a4-c71cfb708ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:05 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Volume volume-90452194-919d-49b3-8ed7-881b762f7c04 (90452194-919d-49b3-8ed7-881b762f7c04): created successfully Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63ac695-d306-4a27-98f0-55df17eb9f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Flow 'volume_create_manager' (136287ab-575f-4eb9-828e-1a058175569f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe023ea-cd49-41d1-90a4-c71cfb708ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1937342820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0761e1e3-1264-496f-aba7-43831599a4eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa47863a19294b4ca2cb1b707a233386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:05Z,use_quota=True,user_id='3e8e36c751be4b2ebfd42e7852432785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f267056e-00b8-4e3a-8b25-344f6a5ca5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f267056e-00b8-4e3a-8b25-344f6a5ca5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2087e4f-530f-4933-b2e0-d271960b5893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2087e4f-530f-4933-b2e0-d271960b5893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0761e1e3-1264-496f-aba7-43831599a4eb', 'volume_name': 'volume-0761e1e3-1264-496f-aba7-43831599a4eb', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bada02ad-022c-47c7-b6a2-fbd177c41917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bada02ad-022c-47c7-b6a2-fbd177c41917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40eee36-a2fe-4571-a7e1-130d2c40b9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:05 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Volume 0761e1e3-1264-496f-aba7-43831599a4eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0761e1e3-1264-496f-aba7-43831599a4eb', 'volume_size': 1} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:05 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-24d34252-f628-4bbc-99d2-929144ffb3fb tempest-CreateVolumesFromImageTest-1320356657 None] Created volume successfully. Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Flow 'volume_create_manager' (d2213d74-64d2-44b9-92eb-ee47b25d0eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f9a40e-4ca7-43fe-ac04-b7007772cedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f9a40e-4ca7-43fe-ac04-b7007772cedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1848473081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b01009-96a7-4c25-9fa7-3a43a77885a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa47863a19294b4ca2cb1b707a233386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:06Z,use_quota=True,user_id='3e8e36c751be4b2ebfd42e7852432785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd8d792-3d63-4e04-8248-c069422d8817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd8d792-3d63-4e04-8248-c069422d8817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e77f67-8456-41fe-87df-bca3eda443a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e77f67-8456-41fe-87df-bca3eda443a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92b01009-96a7-4c25-9fa7-3a43a77885a3', 'volume_name': 'volume-92b01009-96a7-4c25-9fa7-3a43a77885a3', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7885c8a0-b244-4663-a6d3-1a08fb8a67b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7885c8a0-b244-4663-a6d3-1a08fb8a67b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c1c814-b710-4f65-a831-f9feaea5e9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:05 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Volume 92b01009-96a7-4c25-9fa7-3a43a77885a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92b01009-96a7-4c25-9fa7-3a43a77885a3', 'volume_size': 1} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce4e7ddc-f9f7-4f5a-a9e1-359a20f3c1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'be32a5fc-31f5-478f-85fb-ab87d4b1e5a9', 'volume_name': 'volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9', 'volume_size': 1, 'image_id': 'a7ab245b-6dd6-48d3-a272-cf701cafe25c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7ab245b-6dd6-48d3-a272-cf701cafe25c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '956e859d9e68d99eb2e26fc5c0117ec8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a0ab3fb59cbb444a883f500a93370a9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a2a561b813c399aefa2d98a64ee876c04a9f563d49c1be92d208d0da1ad4a320fa831a2a7de6a018279bde10cf5296e097c2cef5cf8715702720a6e196f8cca', 'id': 'a7ab245b-6dd6-48d3-a272-cf701cafe25c', 'created_at': datetime.datetime(2026, 7, 14, 11, 15, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 11, 15, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7ab245b-6dd6-48d3-a272-cf701cafe25c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c31966-b87a-484f-8158-60173f6978cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c31966-b87a-484f-8158-60173f6978cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:05 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ceceb90-e2ee-46d8-bcde-302348968fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:05 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Volume be32a5fc-31f5-478f-85fb-ab87d4b1e5a9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9', 'volume_size': 1, 'image_id': 'a7ab245b-6dd6-48d3-a272-cf701cafe25c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7ab245b-6dd6-48d3-a272-cf701cafe25c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '956e859d9e68d99eb2e26fc5c0117ec8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a0ab3fb59cbb444a883f500a93370a9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a2a561b813c399aefa2d98a64ee876c04a9f563d49c1be92d208d0da1ad4a320fa831a2a7de6a018279bde10cf5296e097c2cef5cf8715702720a6e196f8cca', 'id': 'a7ab245b-6dd6-48d3-a272-cf701cafe25c', 'created_at': datetime.datetime(2026, 7, 14, 11, 15, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 11, 15, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7ab245b-6dd6-48d3-a272-cf701cafe25c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Trying to clone be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 from image a7ab245b-6dd6-48d3-a272-cf701cafe25c at location (None, [{'url': 'file:///opt/stack/data/glance/images/a7ab245b-6dd6-48d3-a272-cf701cafe25c', 'metadata': {}}]). {{(pid=86977) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5007647c-bab4-476e-a11b-e2f9d384b2c1 1073741824" returned: 0 in 0.567s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5007647c-bab4-476e-a11b-e2f9d384b2c1 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:05 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5007647c-bab4-476e-a11b-e2f9d384b2c1 Jul 14 13:15:05 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:751}} Jul 14 13:15:05 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Image download 0.00 MB at 0.00 MB/s Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bc352d-8e45-4c4a-8bc5-5a453223f4fa]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:06 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Flow 'volume_create_manager' (ae8a5eaf-91f3-4799-bc4a-d854a009dd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f951fe-dc22-4a6e-bd4f-d00213a1ca27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5007647c-bab4-476e-a11b-e2f9d384b2c1" returned: 0 in 0.339s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.953s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:06 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-224941381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef8fb22-3713-469a-a894-9b06e29fcd34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='861a31ded75946e09a160f4399903eab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:03Z,use_quota=True,user_id='b8635997ab6e428998f4dc06f1d96b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Creating volume 3ef8fb22-3713-469a-a894-9b06e29fcd34 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:06 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:06 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3ef8fb22-3713-469a-a894-9b06e29fcd34 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f951fe-dc22-4a6e-bd4f-d00213a1ca27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-754278801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ddc1af6-121e-4804-a832-99e07ff85ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa47863a19294b4ca2cb1b707a233386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:06Z,use_quota=True,user_id='3e8e36c751be4b2ebfd42e7852432785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b68308-c939-45f3-bae9-44cbfac9d78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b68308-c939-45f3-bae9-44cbfac9d78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:06 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3ef8fb22-3713-469a-a894-9b06e29fcd34 1073741824 Jul 14 13:15:06 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd509398-8737-433a-bb83-b8c5957e080b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd509398-8737-433a-bb83-b8c5957e080b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ddc1af6-121e-4804-a832-99e07ff85ebf', 'volume_name': 'volume-6ddc1af6-121e-4804-a832-99e07ff85ebf', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cfbd549-55c6-4500-87ef-1c2f7f56c3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cfbd549-55c6-4500-87ef-1c2f7f56c3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28aef0d0-5d2f-485e-901b-f3a7fb234938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:06 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Volume 6ddc1af6-121e-4804-a832-99e07ff85ebf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ddc1af6-121e-4804-a832-99e07ff85ebf', 'volume_size': 1} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dac6a68-e7a1-42ae-bf7f-9f19aa036bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5007647c-bab4-476e-a11b-e2f9d384b2c1', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4d7fd1-df07-4b8b-8f6f-42bedf4513b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:06 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Volume volume-5007647c-bab4-476e-a11b-e2f9d384b2c1 (5007647c-bab4-476e-a11b-e2f9d384b2c1): created successfully Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4d7fd1-df07-4b8b-8f6f-42bedf4513b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Flow 'volume_create_manager' (98a07fc5-f3f3-413f-82d2-ab34a7ee86d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:06 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-6e0a0b13-c167-4803-9212-61e4840e1704 tempest-CreateVolumesFromImageTest-1320356657 None] Created volume successfully. Jul 14 13:15:06 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD" returned: 0 in 0.442s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Flow 'volume_create_manager' (202df29c-d2ed-45a8-a3c6-a80dc4663d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf06cb3-c362-48fb-9fe1-8d4e69ca9621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf06cb3-c362-48fb-9fe1-8d4e69ca9621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-746755089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eae1746-2ebd-436c-b4e0-389009f77b56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa47863a19294b4ca2cb1b707a233386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:06Z,use_quota=True,user_id='3e8e36c751be4b2ebfd42e7852432785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62810c83-7b11-48ae-86c1-b9e788b83709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62810c83-7b11-48ae-86c1-b9e788b83709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4dbf8d-afd0-404e-b339-140dd05f500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4dbf8d-afd0-404e-b339-140dd05f500f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eae1746-2ebd-436c-b4e0-389009f77b56', 'volume_name': 'volume-2eae1746-2ebd-436c-b4e0-389009f77b56', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee22aaf1-e872-4f0c-83bd-fa84c1aada3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee22aaf1-e872-4f0c-83bd-fa84c1aada3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d545ff-cc86-4f49-a52d-ad056dd774cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:06 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Volume 2eae1746-2ebd-436c-b4e0-389009f77b56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eae1746-2ebd-436c-b4e0-389009f77b56', 'volume_size': 1} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:06 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD Jul 14 13:15:06 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:06 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3ef8fb22-3713-469a-a894-9b06e29fcd34 1073741824" returned: 0 in 0.501s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3ef8fb22-3713-469a-a894-9b06e29fcd34 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:06 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3ef8fb22-3713-469a-a894-9b06e29fcd34 Jul 14 13:15:06 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:06 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD" returned: 1 in 0.382s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Temporary image a7ab245b-6dd6-48d3-a272-cf701cafe25c is fetched for user ebb957e3f7a1469ca73222a79819ea41. {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:1450}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[97964aeb-bdbc-4ff3-b5ff-53c33b4b96d6]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:06 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3ef8fb22-3713-469a-a894-9b06e29fcd34" returned: 0 in 0.265s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-eb181634-0730-4866-acd8-74ea14ba3834 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.616s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-eb181634-0730-4866-acd8-74ea14ba3834 tempest-CreateVolumesFromSnapshotTest-969137350 None] Creating offline snapshot cf98b4af-1746-4cdc-aad5-de9a328b9cdb of volume 8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:15:07 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD Jul 14 13:15:07 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:07 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cbc8aae-518a-4965-b9f3-dddbadaa05d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ef8fb22-3713-469a-a894-9b06e29fcd34', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:07 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d09792-7fe7-45b5-9d90-885b32402470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:07 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab675b4-a1ca-440d-9fc8-2332e426cddf]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-eb181634-0730-4866-acd8-74ea14ba3834 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:07 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Volume volume-3ef8fb22-3713-469a-a894-9b06e29fcd34 (3ef8fb22-3713-469a-a894-9b06e29fcd34): created successfully Jul 14 13:15:07 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d09792-7fe7-45b5-9d90-885b32402470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:07 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Flow 'volume_create_manager' (c8c67866-bc8d-47d7-9470-55a3bf5f2b5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:07 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-ac636fd4-810c-46b9-8d98-5b1088c507f3 tempest-CreateVolumesFromImageTest-1320356657 None] Created volume successfully. Jul 14 13:15:07 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b Jul 14 13:15:07 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:07 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:07 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD Jul 14 13:15:07 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:07 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-eb181634-0730-4866-acd8-74ea14ba3834 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b" returned: 0 in 0.377s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-eb181634-0730-4866-acd8-74ea14ba3834 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.cf98b4af-1746-4cdc-aad5-de9a328b9cdb 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:07 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.cf98b4af-1746-4cdc-aad5-de9a328b9cdb 1G Jul 14 13:15:07 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:07 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD" returned: 1 in 0.340s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:15:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:07 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-eb181634-0730-4866-acd8-74ea14ba3834 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.cf98b4af-1746-4cdc-aad5-de9a328b9cdb 1G" returned: 0 in 0.388s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-eb181634-0730-4866-acd8-74ea14ba3834 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.cf98b4af-1746-4cdc-aad5-de9a328b9cdb {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:07 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.cf98b4af-1746-4cdc-aad5-de9a328b9cdb Jul 14 13:15:07 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:08 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-eb181634-0730-4866-acd8-74ea14ba3834 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.cf98b4af-1746-4cdc-aad5-de9a328b9cdb" returned: 0 in 0.299s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:08 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-eb181634-0730-4866-acd8-74ea14ba3834 tempest-CreateVolumesFromSnapshotTest-969137350 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.cf98b4af-1746-4cdc-aad5-de9a328b9cdb is being set with open permissions: ugo+rw Jul 14 13:15:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-eb181634-0730-4866-acd8-74ea14ba3834 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.cf98b4af-1746-4cdc-aad5-de9a328b9cdb {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:08 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.cf98b4af-1746-4cdc-aad5-de9a328b9cdb Jul 14 13:15:08 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:08 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-eb181634-0730-4866-acd8-74ea14ba3834 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.cf98b4af-1746-4cdc-aad5-de9a328b9cdb" returned: 0 in 0.245s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-eb181634-0730-4866-acd8-74ea14ba3834 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:08 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.info Jul 14 13:15:08 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:08 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-eb181634-0730-4866-acd8-74ea14ba3834 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.info" returned: 0 in 0.259s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:08 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-eb181634-0730-4866-acd8-74ea14ba3834 tempest-CreateVolumesFromSnapshotTest-969137350 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.info is being set with open permissions: ugo+rw Jul 14 13:15:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-eb181634-0730-4866-acd8-74ea14ba3834 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:08 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.info Jul 14 13:15:08 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:08 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-eb181634-0730-4866-acd8-74ea14ba3834 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.info" returned: 0 in 0.250s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-eb181634-0730-4866-acd8-74ea14ba3834 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.934s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.244s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:08 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-626664238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08aa5661-7354-4494-891d-4401df2e12d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='861a31ded75946e09a160f4399903eab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:04Z,use_quota=True,user_id='b8635997ab6e428998f4dc06f1d96b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:08 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Creating volume 08aa5661-7354-4494-891d-4401df2e12d0 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:08 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:08 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:08 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:08 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-08aa5661-7354-4494-891d-4401df2e12d0 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:08 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-08aa5661-7354-4494-891d-4401df2e12d0 1073741824 Jul 14 13:15:08 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:08 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-eb181634-0730-4866-acd8-74ea14ba3834 tempest-CreateVolumesFromSnapshotTest-969137350 None] Create snapshot completed successfully Jul 14 13:15:09 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-08aa5661-7354-4494-891d-4401df2e12d0 1073741824" returned: 0 in 0.414s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-08aa5661-7354-4494-891d-4401df2e12d0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:09 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-08aa5661-7354-4494-891d-4401df2e12d0 Jul 14 13:15:09 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:09 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-08aa5661-7354-4494-891d-4401df2e12d0" returned: 0 in 0.249s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.537s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1833426540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=562ffe7e-843d-4f74-9ce7-6d52f9144314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa47863a19294b4ca2cb1b707a233386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:05Z,use_quota=True,user_id='3e8e36c751be4b2ebfd42e7852432785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Creating volume 562ffe7e-843d-4f74-9ce7-6d52f9144314 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:09 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-562ffe7e-843d-4f74-9ce7-6d52f9144314 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:09 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-562ffe7e-843d-4f74-9ce7-6d52f9144314 1073741824 Jul 14 13:15:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65acece-c51d-41ff-8c91-d30feebfee4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08aa5661-7354-4494-891d-4401df2e12d0', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:09 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759088c4-363c-4506-9765-91676e488867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:09 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Volume volume-08aa5661-7354-4494-891d-4401df2e12d0 (08aa5661-7354-4494-891d-4401df2e12d0): created successfully Jul 14 13:15:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759088c4-363c-4506-9765-91676e488867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Flow 'volume_create_manager' (7064c3f1-c9c3-4280-b93f-a704d6de5962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:09 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-bced0f7b-601a-426e-aa26-d5aa98acf839 tempest-CreateVolumesFromImageTest-1320356657 None] Created volume successfully. Jul 14 13:15:10 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-562ffe7e-843d-4f74-9ce7-6d52f9144314 1073741824" returned: 0 in 0.440s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-562ffe7e-843d-4f74-9ce7-6d52f9144314 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:10 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-562ffe7e-843d-4f74-9ce7-6d52f9144314 Jul 14 13:15:10 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Flow 'volume_create_manager' (60048f29-9ba8-4d73-acfc-be52dfa03b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fbdb70a-a2e2-4bfd-9dd1-adb8585d8553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fbdb70a-a2e2-4bfd-9dd1-adb8585d8553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2072965182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6a332e4-a1ee-4c98-8c1f-3250439db420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e90439a9fe8f4c168ce63d7cc37482a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:10Z,use_quota=True,user_id='d8e42126b84c4fe5b9273cc120315fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48dc852e-8250-4d44-9096-bdb8a5a1348c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48dc852e-8250-4d44-9096-bdb8a5a1348c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (385344a0-3f59-4282-b4dc-71a5ac59c4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (385344a0-3f59-4282-b4dc-71a5ac59c4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6a332e4-a1ee-4c98-8c1f-3250439db420', 'volume_name': 'volume-e6a332e4-a1ee-4c98-8c1f-3250439db420', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2807e74a-8df7-4a13-89f7-cbc4f693a7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2807e74a-8df7-4a13-89f7-cbc4f693a7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f92881-8183-43ff-9f97-2d9f424b1181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:10 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Volume e6a332e4-a1ee-4c98-8c1f-3250439db420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6a332e4-a1ee-4c98-8c1f-3250439db420', 'volume_size': 1} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:10 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ed161017-e808-43e9-a1ef-e5b75cfe4c98 tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "cinder-08aa5661-7354-4494-891d-4401df2e12d0-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-562ffe7e-843d-4f74-9ce7-6d52f9144314" returned: 0 in 0.319s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.039s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1937342820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0761e1e3-1264-496f-aba7-43831599a4eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa47863a19294b4ca2cb1b707a233386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:05Z,use_quota=True,user_id='3e8e36c751be4b2ebfd42e7852432785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Creating volume 0761e1e3-1264-496f-aba7-43831599a4eb {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:10 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0761e1e3-1264-496f-aba7-43831599a4eb 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ed161017-e808-43e9-a1ef-e5b75cfe4c98 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "cinder-08aa5661-7354-4494-891d-4401df2e12d0-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:10 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0761e1e3-1264-496f-aba7-43831599a4eb 1073741824 Jul 14 13:15:10 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708a2639-a277-4f34-9db2-b7c87165c80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-562ffe7e-843d-4f74-9ce7-6d52f9144314', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56f57aa-6161-4595-8454-309881a326dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:10 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Volume volume-562ffe7e-843d-4f74-9ce7-6d52f9144314 (562ffe7e-843d-4f74-9ce7-6d52f9144314): created successfully Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56f57aa-6161-4595-8454-309881a326dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Flow 'volume_create_manager' (859d91dc-62d0-449f-baff-7923740e873f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ed161017-e808-43e9-a1ef-e5b75cfe4c98 tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "cinder-quobyte-08aa5661-7354-4494-891d-4401df2e12d0" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:10 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-a26521b2-7263-4d44-93e6-4c65f999c16e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Created volume successfully. Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ed161017-e808-43e9-a1ef-e5b75cfe4c98 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "cinder-quobyte-08aa5661-7354-4494-891d-4401df2e12d0" acquired by "delete_volume" :: waited 0.043s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f910253-aa77-4045-ae91-05ff1758273e]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ed161017-e808-43e9-a1ef-e5b75cfe4c98 tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-08aa5661-7354-4494-891d-4401df2e12d0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:10 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-08aa5661-7354-4494-891d-4401df2e12d0 Jul 14 13:15:10 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Flow 'volume_create_manager' (ff0bef41-990d-460a-a9ad-a0cdcff550d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa35fbbe-db9b-4ff1-90a8-a6afd04a5c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa35fbbe-db9b-4ff1-90a8-a6afd04a5c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1275268459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c107a2-a298-4227-beaa-7d46244f31eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e90439a9fe8f4c168ce63d7cc37482a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:11Z,use_quota=True,user_id='d8e42126b84c4fe5b9273cc120315fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21feb55-b5dc-4602-a648-1f56a76fc9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21feb55-b5dc-4602-a648-1f56a76fc9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c42fe6-b050-4f6b-9ad1-01686c3422dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c42fe6-b050-4f6b-9ad1-01686c3422dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00c107a2-a298-4227-beaa-7d46244f31eb', 'volume_name': 'volume-00c107a2-a298-4227-beaa-7d46244f31eb', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d258a512-4be1-4041-9f21-5225b9bf2ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d258a512-4be1-4041-9f21-5225b9bf2ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9f8cb1-99bc-48e3-b281-2674b18f302e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:10 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Volume 00c107a2-a298-4227-beaa-7d46244f31eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00c107a2-a298-4227-beaa-7d46244f31eb', 'volume_size': 1} Jul 14 13:15:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:11 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0761e1e3-1264-496f-aba7-43831599a4eb 1073741824" returned: 0 in 0.572s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0761e1e3-1264-496f-aba7-43831599a4eb {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:11 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0761e1e3-1264-496f-aba7-43831599a4eb Jul 14 13:15:11 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:11 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ed161017-e808-43e9-a1ef-e5b75cfe4c98 tempest-CreateVolumesFromImageTest-1320356657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-08aa5661-7354-4494-891d-4401df2e12d0" returned: 0 in 0.459s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ed161017-e808-43e9-a1ef-e5b75cfe4c98 tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-08aa5661-7354-4494-891d-4401df2e12d0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:11 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-08aa5661-7354-4494-891d-4401df2e12d0 Jul 14 13:15:11 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Flow 'volume_create_manager' (35758f58-bab5-497e-973c-923f9f7a9560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e4cd2c0-37ed-42ba-a827-1d87ad52469a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e4cd2c0-37ed-42ba-a827-1d87ad52469a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2068361147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114f5745-1eae-4900-913f-b94fe6a7dad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e90439a9fe8f4c168ce63d7cc37482a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:11Z,use_quota=True,user_id='d8e42126b84c4fe5b9273cc120315fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a31187-b4d3-4946-bc25-6efee23b3eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a31187-b4d3-4946-bc25-6efee23b3eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3c7010-0308-4702-b992-6b1ba9e4bb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3c7010-0308-4702-b992-6b1ba9e4bb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114f5745-1eae-4900-913f-b94fe6a7dad2', 'volume_name': 'volume-114f5745-1eae-4900-913f-b94fe6a7dad2', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51449ef5-9e2d-44d9-bfc9-89171696c670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51449ef5-9e2d-44d9-bfc9-89171696c670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452cc9e1-79a7-4a9f-9527-13a6072540a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:11 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Volume 114f5745-1eae-4900-913f-b94fe6a7dad2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114f5745-1eae-4900-913f-b94fe6a7dad2', 'volume_size': 1} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:11 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0761e1e3-1264-496f-aba7-43831599a4eb" returned: 0 in 0.349s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.721s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1848473081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b01009-96a7-4c25-9fa7-3a43a77885a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa47863a19294b4ca2cb1b707a233386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:06Z,use_quota=True,user_id='3e8e36c751be4b2ebfd42e7852432785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Creating volume 92b01009-96a7-4c25-9fa7-3a43a77885a3 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:11 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92b01009-96a7-4c25-9fa7-3a43a77885a3 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:11 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40eee36-a2fe-4571-a7e1-130d2c40b9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0761e1e3-1264-496f-aba7-43831599a4eb', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597295a0-7d39-4b28-9c58-1568b292de5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:11 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92b01009-96a7-4c25-9fa7-3a43a77885a3 1073741824 Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ed161017-e808-43e9-a1ef-e5b75cfe4c98 tempest-CreateVolumesFromImageTest-1320356657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-08aa5661-7354-4494-891d-4401df2e12d0" returned: 0 in 0.366s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:11 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:11 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Volume volume-0761e1e3-1264-496f-aba7-43831599a4eb (0761e1e3-1264-496f-aba7-43831599a4eb): created successfully Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597295a0-7d39-4b28-9c58-1568b292de5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Flow 'volume_create_manager' (80fca12a-7089-4b47-89b8-f7081c5b5d94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ed161017-e808-43e9-a1ef-e5b75cfe4c98 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "cinder-quobyte-08aa5661-7354-4494-891d-4401df2e12d0" released by "delete_volume" :: held 0.899s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:11 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-8a8df6b2-bafd-4bf6-9abc-f4f252a86d47 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Created volume successfully. Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-ed161017-e808-43e9-a1ef-e5b75cfe4c98 tempest-CreateVolumesFromImageTest-1320356657 None] Created reservations ['5c01c50b-9508-42b8-a2f1-43702ed7c5ed', 'a8b885d5-7bf5-4643-9b91-05117da43f04', '874c677d-527c-4051-a5a2-54df752a01fa', '4d876873-ae83-44d6-93df-628025948e65'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Flow 'volume_create_manager' (624a7db0-b243-44a1-acda-2c0dae1bffb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce4b401-6e71-497d-8082-314d5e53213a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce4b401-6e71-497d-8082-314d5e53213a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1878454022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0565e852-a3f8-4aaa-952f-64ceb6002ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e90439a9fe8f4c168ce63d7cc37482a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:12Z,use_quota=True,user_id='d8e42126b84c4fe5b9273cc120315fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bfae686-1637-44ad-9706-ad77bfe32f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bfae686-1637-44ad-9706-ad77bfe32f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c08c11-d793-4b0e-ac0c-741f627733f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c08c11-d793-4b0e-ac0c-741f627733f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0565e852-a3f8-4aaa-952f-64ceb6002ec9', 'volume_name': 'volume-0565e852-a3f8-4aaa-952f-64ceb6002ec9', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d217758-9f94-4f0e-8f5c-054ae1834717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d217758-9f94-4f0e-8f5c-054ae1834717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69d1a30-751a-4571-8192-a41a455d3a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:11 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Volume 0565e852-a3f8-4aaa-952f-64ceb6002ec9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0565e852-a3f8-4aaa-952f-64ceb6002ec9', 'volume_size': 1} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ed161017-e808-43e9-a1ef-e5b75cfe4c98 tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ed161017-e808-43e9-a1ef-e5b75cfe4c98 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ed161017-e808-43e9-a1ef-e5b75cfe4c98 tempest-CreateVolumesFromImageTest-1320356657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ed161017-e808-43e9-a1ef-e5b75cfe4c98 tempest-CreateVolumesFromImageTest-1320356657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ed161017-e808-43e9-a1ef-e5b75cfe4c98 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ed161017-e808-43e9-a1ef-e5b75cfe4c98 tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:11 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:11 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:11 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92b01009-96a7-4c25-9fa7-3a43a77885a3 1073741824" returned: 0 in 0.553s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92b01009-96a7-4c25-9fa7-3a43a77885a3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:12 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92b01009-96a7-4c25-9fa7-3a43a77885a3 Jul 14 13:15:12 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:12 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ed161017-e808-43e9-a1ef-e5b75cfe4c98 tempest-CreateVolumesFromImageTest-1320356657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.327s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-ed161017-e808-43e9-a1ef-e5b75cfe4c98 tempest-CreateVolumesFromImageTest-1320356657 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:12 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-ed161017-e808-43e9-a1ef-e5b75cfe4c98 tempest-CreateVolumesFromImageTest-1320356657 None] Deleted volume successfully. Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ed161017-e808-43e9-a1ef-e5b75cfe4c98 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "cinder-08aa5661-7354-4494-891d-4401df2e12d0-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Flow 'volume_create_manager' (713a0d2a-233a-4b9f-b4f7-7cf952cbf835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304a2d6c-2ba5-4558-a497-73b3569f52aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304a2d6c-2ba5-4558-a497-73b3569f52aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1058250461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b12001-f957-4eaa-9fe1-17cae9826c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e90439a9fe8f4c168ce63d7cc37482a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:12Z,use_quota=True,user_id='d8e42126b84c4fe5b9273cc120315fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ac2c34-e5ef-4c49-be18-4b707641ae99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ac2c34-e5ef-4c49-be18-4b707641ae99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497db169-b48f-4fb3-9f59-467e44e63b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497db169-b48f-4fb3-9f59-467e44e63b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2b12001-f957-4eaa-9fe1-17cae9826c34', 'volume_name': 'volume-c2b12001-f957-4eaa-9fe1-17cae9826c34', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d53b39e-1b5e-4ad2-ad76-b7108020d765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d53b39e-1b5e-4ad2-ad76-b7108020d765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f72514-a901-4fb6-a682-1578e1e53e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:12 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Volume c2b12001-f957-4eaa-9fe1-17cae9826c34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2b12001-f957-4eaa-9fe1-17cae9826c34', 'volume_size': 1} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:12 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92b01009-96a7-4c25-9fa7-3a43a77885a3" returned: 0 in 0.269s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.061s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-754278801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ddc1af6-121e-4804-a832-99e07ff85ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa47863a19294b4ca2cb1b707a233386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:06Z,use_quota=True,user_id='3e8e36c751be4b2ebfd42e7852432785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Creating volume 6ddc1af6-121e-4804-a832-99e07ff85ebf {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:12 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ddc1af6-121e-4804-a832-99e07ff85ebf 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c1c814-b710-4f65-a831-f9feaea5e9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92b01009-96a7-4c25-9fa7-3a43a77885a3', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:12 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ddc1af6-121e-4804-a832-99e07ff85ebf 1073741824 Jul 14 13:15:12 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a733582-c880-4284-9bfc-11d38bafdd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:12 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Volume volume-92b01009-96a7-4c25-9fa7-3a43a77885a3 (92b01009-96a7-4c25-9fa7-3a43a77885a3): created successfully Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a733582-c880-4284-9bfc-11d38bafdd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Flow 'volume_create_manager' (d2213d74-64d2-44b9-92eb-ee47b25d0eb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:12 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-0a413f33-d683-4b79-8bcf-ec20ec904091 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Created volume successfully. Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-63beec64-127b-4d16-b51c-2cd6590c0919 tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "cinder-3ef8fb22-3713-469a-a894-9b06e29fcd34-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:12 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ddc1af6-121e-4804-a832-99e07ff85ebf 1073741824" returned: 0 in 0.464s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-63beec64-127b-4d16-b51c-2cd6590c0919 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "cinder-3ef8fb22-3713-469a-a894-9b06e29fcd34-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ddc1af6-121e-4804-a832-99e07ff85ebf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-63beec64-127b-4d16-b51c-2cd6590c0919 tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "cinder-quobyte-3ef8fb22-3713-469a-a894-9b06e29fcd34" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:12 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ddc1af6-121e-4804-a832-99e07ff85ebf Jul 14 13:15:12 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-63beec64-127b-4d16-b51c-2cd6590c0919 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "cinder-quobyte-3ef8fb22-3713-469a-a894-9b06e29fcd34" acquired by "delete_volume" :: waited 0.015s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c6de75-a21e-4ffe-b12f-e429ffbbcf99]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-63beec64-127b-4d16-b51c-2cd6590c0919 tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3ef8fb22-3713-469a-a894-9b06e29fcd34 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:13 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3ef8fb22-3713-469a-a894-9b06e29fcd34 Jul 14 13:15:13 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:13 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ddc1af6-121e-4804-a832-99e07ff85ebf" returned: 0 in 0.289s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.528s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-746755089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eae1746-2ebd-436c-b4e0-389009f77b56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa47863a19294b4ca2cb1b707a233386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:06Z,use_quota=True,user_id='3e8e36c751be4b2ebfd42e7852432785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Creating volume 2eae1746-2ebd-436c-b4e0-389009f77b56 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:13 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2eae1746-2ebd-436c-b4e0-389009f77b56 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28aef0d0-5d2f-485e-901b-f3a7fb234938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ddc1af6-121e-4804-a832-99e07ff85ebf', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:13 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2eae1746-2ebd-436c-b4e0-389009f77b56 1073741824 Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9fd313-6367-4cd3-a57d-d9ee7fc0e9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:13 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:13 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Volume volume-6ddc1af6-121e-4804-a832-99e07ff85ebf (6ddc1af6-121e-4804-a832-99e07ff85ebf): created successfully Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9fd313-6367-4cd3-a57d-d9ee7fc0e9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Flow 'volume_create_manager' (ae8a5eaf-91f3-4799-bc4a-d854a009dd6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:13 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-aef5e588-bcab-437e-8c6b-f55e5133912a tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Created volume successfully. Jul 14 13:15:13 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-63beec64-127b-4d16-b51c-2cd6590c0919 tempest-CreateVolumesFromImageTest-1320356657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3ef8fb22-3713-469a-a894-9b06e29fcd34" returned: 0 in 0.395s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-63beec64-127b-4d16-b51c-2cd6590c0919 tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3ef8fb22-3713-469a-a894-9b06e29fcd34 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:13 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3ef8fb22-3713-469a-a894-9b06e29fcd34 Jul 14 13:15:13 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:13 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-63beec64-127b-4d16-b51c-2cd6590c0919 tempest-CreateVolumesFromImageTest-1320356657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3ef8fb22-3713-469a-a894-9b06e29fcd34" returned: 0 in 0.266s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:13 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2eae1746-2ebd-436c-b4e0-389009f77b56 1073741824" returned: 0 in 0.433s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-63beec64-127b-4d16-b51c-2cd6590c0919 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "cinder-quobyte-3ef8fb22-3713-469a-a894-9b06e29fcd34" released by "delete_volume" :: held 0.701s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2eae1746-2ebd-436c-b4e0-389009f77b56 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:13 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2eae1746-2ebd-436c-b4e0-389009f77b56 Jul 14 13:15:13 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-63beec64-127b-4d16-b51c-2cd6590c0919 tempest-CreateVolumesFromImageTest-1320356657 None] Created reservations ['8d9268b3-b70f-4666-974d-29d4b850ff53', 'e06e1907-0ee7-4065-8e79-c1f3e51517ca', 'db5e60f3-2cc7-41bb-8de9-123ab5d0605a', '5f5cc711-1fdf-42dc-8709-d63e7879c870'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-63beec64-127b-4d16-b51c-2cd6590c0919 tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-63beec64-127b-4d16-b51c-2cd6590c0919 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-63beec64-127b-4d16-b51c-2cd6590c0919 tempest-CreateVolumesFromImageTest-1320356657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-63beec64-127b-4d16-b51c-2cd6590c0919 tempest-CreateVolumesFromImageTest-1320356657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-63beec64-127b-4d16-b51c-2cd6590c0919 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-63beec64-127b-4d16-b51c-2cd6590c0919 tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:13 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:13 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:13 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2eae1746-2ebd-436c-b4e0-389009f77b56" returned: 0 in 0.259s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.260s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be32a5fc-31f5-478f-85fb-ab87d4b1e5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ab3fb59cbb444a883f500a93370a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:05Z,use_quota=True,user_id='ebb957e3f7a1469ca73222a79819ea41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(557695c1-5737-486b-8c84-59479309c18e),volume_type_id=557695c1-5737-486b-8c84-59479309c18e)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Creating volume be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:13 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d545ff-cc86-4f49-a52d-ad056dd774cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eae1746-2ebd-436c-b4e0-389009f77b56', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0fb12f7-0f06-4b2a-8f14-904b58b4ebad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:13 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 1073741824 Jul 14 13:15:13 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:13 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Volume volume-2eae1746-2ebd-436c-b4e0-389009f77b56 (2eae1746-2ebd-436c-b4e0-389009f77b56): created successfully Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0fb12f7-0f06-4b2a-8f14-904b58b4ebad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Flow 'volume_create_manager' (202df29c-d2ed-45a8-a3c6-a80dc4663d9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-36531658-dff8-4fb8-9a72-fddb56a6bb48 tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "cinder-5007647c-bab4-476e-a11b-e2f9d384b2c1-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:13 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-cef5d1f1-4a71-4856-bfe8-d67b21553a9e tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Created volume successfully. Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-36531658-dff8-4fb8-9a72-fddb56a6bb48 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "cinder-5007647c-bab4-476e-a11b-e2f9d384b2c1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:13 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-63beec64-127b-4d16-b51c-2cd6590c0919 tempest-CreateVolumesFromImageTest-1320356657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.290s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:13 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-63beec64-127b-4d16-b51c-2cd6590c0919 tempest-CreateVolumesFromImageTest-1320356657 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:14 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-63beec64-127b-4d16-b51c-2cd6590c0919 tempest-CreateVolumesFromImageTest-1320356657 None] Deleted volume successfully. Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-36531658-dff8-4fb8-9a72-fddb56a6bb48 tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "cinder-quobyte-5007647c-bab4-476e-a11b-e2f9d384b2c1" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-63beec64-127b-4d16-b51c-2cd6590c0919 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "cinder-3ef8fb22-3713-469a-a894-9b06e29fcd34-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-36531658-dff8-4fb8-9a72-fddb56a6bb48 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "cinder-quobyte-5007647c-bab4-476e-a11b-e2f9d384b2c1" acquired by "delete_volume" :: waited 0.031s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1472e7b-79c6-4f0c-aa79-d705fb17b4d4]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-36531658-dff8-4fb8-9a72-fddb56a6bb48 tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5007647c-bab4-476e-a11b-e2f9d384b2c1 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:14 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5007647c-bab4-476e-a11b-e2f9d384b2c1 Jul 14 13:15:14 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d138a284-c1e4-4f0e-a28f-576c9db1b499 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "cinder-2eae1746-2ebd-436c-b4e0-389009f77b56-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d138a284-c1e4-4f0e-a28f-576c9db1b499 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-2eae1746-2ebd-436c-b4e0-389009f77b56-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d138a284-c1e4-4f0e-a28f-576c9db1b499 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "cinder-quobyte-2eae1746-2ebd-436c-b4e0-389009f77b56" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d138a284-c1e4-4f0e-a28f-576c9db1b499 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-quobyte-2eae1746-2ebd-436c-b4e0-389009f77b56" acquired by "delete_volume" :: waited 0.015s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bab0f0-b4fa-45c9-8975-c93a00334e95]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d138a284-c1e4-4f0e-a28f-576c9db1b499 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2eae1746-2ebd-436c-b4e0-389009f77b56 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:14 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 1073741824" returned: 0 in 0.567s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:14 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2eae1746-2ebd-436c-b4e0-389009f77b56 Jul 14 13:15:14 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:14 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 Jul 14 13:15:14 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:14 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-36531658-dff8-4fb8-9a72-fddb56a6bb48 tempest-CreateVolumesFromImageTest-1320356657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5007647c-bab4-476e-a11b-e2f9d384b2c1" returned: 0 in 0.429s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-36531658-dff8-4fb8-9a72-fddb56a6bb48 tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5007647c-bab4-476e-a11b-e2f9d384b2c1 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:14 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5007647c-bab4-476e-a11b-e2f9d384b2c1 Jul 14 13:15:14 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:14 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9" returned: 0 in 0.255s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.356s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2072965182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6a332e4-a1ee-4c98-8c1f-3250439db420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e90439a9fe8f4c168ce63d7cc37482a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:10Z,use_quota=True,user_id='d8e42126b84c4fe5b9273cc120315fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Creating volume e6a332e4-a1ee-4c98-8c1f-3250439db420 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:14 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:14 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e6a332e4-a1ee-4c98-8c1f-3250439db420 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d138a284-c1e4-4f0e-a28f-576c9db1b499 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2eae1746-2ebd-436c-b4e0-389009f77b56" returned: 0 in 0.421s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d138a284-c1e4-4f0e-a28f-576c9db1b499 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2eae1746-2ebd-436c-b4e0-389009f77b56 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:14 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e6a332e4-a1ee-4c98-8c1f-3250439db420 1073741824 Jul 14 13:15:14 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:14 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:14 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2eae1746-2ebd-436c-b4e0-389009f77b56 Jul 14 13:15:14 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-36531658-dff8-4fb8-9a72-fddb56a6bb48 tempest-CreateVolumesFromImageTest-1320356657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-5007647c-bab4-476e-a11b-e2f9d384b2c1" returned: 0 in 0.280s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Attempting download of a7ab245b-6dd6-48d3-a272-cf701cafe25c ((None, [{'url': 'file:///opt/stack/data/glance/images/a7ab245b-6dd6-48d3-a272-cf701cafe25c', 'metadata': {}}])) to volume be32a5fc-31f5-478f-85fb-ab87d4b1e5a9. {{(pid=86977) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-36531658-dff8-4fb8-9a72-fddb56a6bb48 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "cinder-quobyte-5007647c-bab4-476e-a11b-e2f9d384b2c1" released by "delete_volume" :: held 0.760s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[5076a730-11ae-4bfc-a38a-d139aabb70e5]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7ab245b-6dd6-48d3-a272-cf701cafe25c_7lw0g1sf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-36531658-dff8-4fb8-9a72-fddb56a6bb48 tempest-CreateVolumesFromImageTest-1320356657 None] Created reservations ['1b2ae7dd-0d71-4959-a956-7e54811e024c', 'f1cf0748-0e77-4090-978d-559074398062', '284803cf-9fe2-4c38-96c6-8cbfdc57deab', '0524f565-42ef-43ad-883c-8f9c889f3828'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-36531658-dff8-4fb8-9a72-fddb56a6bb48 tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-36531658-dff8-4fb8-9a72-fddb56a6bb48 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-36531658-dff8-4fb8-9a72-fddb56a6bb48 tempest-CreateVolumesFromImageTest-1320356657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-36531658-dff8-4fb8-9a72-fddb56a6bb48 tempest-CreateVolumesFromImageTest-1320356657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-36531658-dff8-4fb8-9a72-fddb56a6bb48 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-36531658-dff8-4fb8-9a72-fddb56a6bb48 tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:15 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7ab245b-6dd6-48d3-a272-cf701cafe25c_7lw0g1sf Jul 14 13:15:15 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:15 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:15 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:15 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d138a284-c1e4-4f0e-a28f-576c9db1b499 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2eae1746-2ebd-436c-b4e0-389009f77b56" returned: 0 in 0.306s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d138a284-c1e4-4f0e-a28f-576c9db1b499 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-quobyte-2eae1746-2ebd-436c-b4e0-389009f77b56" released by "delete_volume" :: held 0.777s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-60a52260-06cd-45e3-9600-20c032e7255d tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "cinder-90452194-919d-49b3-8ed7-881b762f7c04-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-d138a284-c1e4-4f0e-a28f-576c9db1b499 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Created reservations ['858971ae-e7d6-4b69-89dd-1eb4b4482fe9', '1df3355b-f1a6-4c7c-bd19-af47080ae56c', 'f9300b31-98d1-4f78-ba72-9bf3e95acd46', 'e18aa016-35dd-4b62-b03d-5fd662b9f56a'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-60a52260-06cd-45e3-9600-20c032e7255d tempest-CreateVolumesFromImageTest-1320356657 None] Lock "cinder-90452194-919d-49b3-8ed7-881b762f7c04-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-60a52260-06cd-45e3-9600-20c032e7255d tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "cinder-quobyte-90452194-919d-49b3-8ed7-881b762f7c04" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-60a52260-06cd-45e3-9600-20c032e7255d tempest-CreateVolumesFromImageTest-1320356657 None] Lock "cinder-quobyte-90452194-919d-49b3-8ed7-881b762f7c04" acquired by "delete_volume" :: waited 0.032s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d138a284-c1e4-4f0e-a28f-576c9db1b499 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d138a284-c1e4-4f0e-a28f-576c9db1b499 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d138a284-c1e4-4f0e-a28f-576c9db1b499 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d138a284-c1e4-4f0e-a28f-576c9db1b499 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d138a284-c1e4-4f0e-a28f-576c9db1b499 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d138a284-c1e4-4f0e-a28f-576c9db1b499 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:15 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e6a332e4-a1ee-4c98-8c1f-3250439db420 1073741824" returned: 0 in 0.617s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce2bbb1-3c17-4e11-b1b5-ccc605668970]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-60a52260-06cd-45e3-9600-20c032e7255d tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-90452194-919d-49b3-8ed7-881b762f7c04 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:15 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:15 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:15 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:15 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e6a332e4-a1ee-4c98-8c1f-3250439db420 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5205b64d-4773-4776-b4dc-90341b55a129 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "cinder-6ddc1af6-121e-4804-a832-99e07ff85ebf-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:15 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e6a332e4-a1ee-4c98-8c1f-3250439db420 Jul 14 13:15:15 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7ab245b-6dd6-48d3-a272-cf701cafe25c_7lw0g1sf" returned: 0 in 0.595s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-36531658-dff8-4fb8-9a72-fddb56a6bb48 tempest-CreateVolumesFromImageTest-1320356657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.477s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7ab245b-6dd6-48d3-a272-cf701cafe25c_7lw0g1sf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-36531658-dff8-4fb8-9a72-fddb56a6bb48 tempest-CreateVolumesFromImageTest-1320356657 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:15 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-36531658-dff8-4fb8-9a72-fddb56a6bb48 tempest-CreateVolumesFromImageTest-1320356657 None] Deleted volume successfully. Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5205b64d-4773-4776-b4dc-90341b55a129 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-6ddc1af6-121e-4804-a832-99e07ff85ebf-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-36531658-dff8-4fb8-9a72-fddb56a6bb48 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "cinder-5007647c-bab4-476e-a11b-e2f9d384b2c1-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:15 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-90452194-919d-49b3-8ed7-881b762f7c04 Jul 14 13:15:15 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5205b64d-4773-4776-b4dc-90341b55a129 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "cinder-quobyte-6ddc1af6-121e-4804-a832-99e07ff85ebf" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5205b64d-4773-4776-b4dc-90341b55a129 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-quobyte-6ddc1af6-121e-4804-a832-99e07ff85ebf" acquired by "delete_volume" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf35627c-14eb-490d-bc5e-ca192d1782ff]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5205b64d-4773-4776-b4dc-90341b55a129 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ddc1af6-121e-4804-a832-99e07ff85ebf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:15 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7ab245b-6dd6-48d3-a272-cf701cafe25c_7lw0g1sf Jul 14 13:15:15 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:15 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d138a284-c1e4-4f0e-a28f-576c9db1b499 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.450s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-d138a284-c1e4-4f0e-a28f-576c9db1b499 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:15 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-d138a284-c1e4-4f0e-a28f-576c9db1b499 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Deleted volume successfully. Jul 14 13:15:15 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:15 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ddc1af6-121e-4804-a832-99e07ff85ebf Jul 14 13:15:15 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e6a332e4-a1ee-4c98-8c1f-3250439db420" returned: 0 in 0.387s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.886s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1275268459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c107a2-a298-4227-beaa-7d46244f31eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e90439a9fe8f4c168ce63d7cc37482a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:11Z,use_quota=True,user_id='d8e42126b84c4fe5b9273cc120315fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Creating volume 00c107a2-a298-4227-beaa-7d46244f31eb {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:15 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00c107a2-a298-4227-beaa-7d46244f31eb 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f92881-8183-43ff-9f97-2d9f424b1181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6a332e4-a1ee-4c98-8c1f-3250439db420', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc49d622-fbf2-4e2d-a136-8b43ab7adefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:15 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00c107a2-a298-4227-beaa-7d46244f31eb 1073741824 Jul 14 13:15:15 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d138a284-c1e4-4f0e-a28f-576c9db1b499 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-2eae1746-2ebd-436c-b4e0-389009f77b56-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:15 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Volume volume-e6a332e4-a1ee-4c98-8c1f-3250439db420 (e6a332e4-a1ee-4c98-8c1f-3250439db420): created successfully Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc49d622-fbf2-4e2d-a136-8b43ab7adefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Flow 'volume_create_manager' (60048f29-9ba8-4d73-acfc-be52dfa03b54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:15 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-874753d3-99b5-4509-8823-37437f863e33 tempest-CreateVolumesFromSnapshotTest-969137350 None] Created volume successfully. Jul 14 13:15:15 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-60a52260-06cd-45e3-9600-20c032e7255d tempest-CreateVolumesFromImageTest-1320356657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-90452194-919d-49b3-8ed7-881b762f7c04" returned: 0 in 0.575s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-60a52260-06cd-45e3-9600-20c032e7255d tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-90452194-919d-49b3-8ed7-881b762f7c04 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:16 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-90452194-919d-49b3-8ed7-881b762f7c04 Jul 14 13:15:16 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:16 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7ab245b-6dd6-48d3-a272-cf701cafe25c_7lw0g1sf" returned: 1 in 0.588s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7ab245b-6dd6-48d3-a272-cf701cafe25c_7lw0g1sf' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98a283c-b24b-4893-9f38-65a14baf589e]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:16 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5205b64d-4773-4776-b4dc-90341b55a129 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ddc1af6-121e-4804-a832-99e07ff85ebf" returned: 0 in 0.430s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5205b64d-4773-4776-b4dc-90341b55a129 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ddc1af6-121e-4804-a832-99e07ff85ebf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:16 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ddc1af6-121e-4804-a832-99e07ff85ebf Jul 14 13:15:16 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:16 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD Jul 14 13:15:16 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:16 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-60a52260-06cd-45e3-9600-20c032e7255d tempest-CreateVolumesFromImageTest-1320356657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-90452194-919d-49b3-8ed7-881b762f7c04" returned: 0 in 0.355s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-60a52260-06cd-45e3-9600-20c032e7255d tempest-CreateVolumesFromImageTest-1320356657 None] Lock "cinder-quobyte-90452194-919d-49b3-8ed7-881b762f7c04" released by "delete_volume" :: held 1.031s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:16 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5205b64d-4773-4776-b4dc-90341b55a129 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ddc1af6-121e-4804-a832-99e07ff85ebf" returned: 0 in 0.279s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5205b64d-4773-4776-b4dc-90341b55a129 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-quobyte-6ddc1af6-121e-4804-a832-99e07ff85ebf" released by "delete_volume" :: held 0.769s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-60a52260-06cd-45e3-9600-20c032e7255d tempest-CreateVolumesFromImageTest-1320356657 None] Created reservations ['264dd982-0f19-45d6-a6dd-405b431a6aac', '2e5b6ba9-0cd2-4e9f-9b4a-cd35e1e03d9f', '9911af78-d291-4e96-93d9-305a3deb2bf5', 'ca71886d-8c99-44ae-9dd9-bdf8ef529a2c'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:16 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00c107a2-a298-4227-beaa-7d46244f31eb 1073741824" returned: 0 in 0.613s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-5205b64d-4773-4776-b4dc-90341b55a129 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Created reservations ['87c400eb-848b-42f6-a1ed-e3497ca4bc0f', '6ad5d836-a99b-451d-8511-c5a81e6bf46c', 'a3e7a25e-7bac-43c0-a3f8-6d8f04667810', '22751544-8861-40d0-9c7e-bb4f37665edb'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:16 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD" returned: 0 in 0.428s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00c107a2-a298-4227-beaa-7d46244f31eb {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:16 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:16 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:16 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00c107a2-a298-4227-beaa-7d46244f31eb Jul 14 13:15:16 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-60a52260-06cd-45e3-9600-20c032e7255d tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-60a52260-06cd-45e3-9600-20c032e7255d tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-60a52260-06cd-45e3-9600-20c032e7255d tempest-CreateVolumesFromImageTest-1320356657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-60a52260-06cd-45e3-9600-20c032e7255d tempest-CreateVolumesFromImageTest-1320356657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-60a52260-06cd-45e3-9600-20c032e7255d tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-60a52260-06cd-45e3-9600-20c032e7255d tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5205b64d-4773-4776-b4dc-90341b55a129 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5205b64d-4773-4776-b4dc-90341b55a129 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5205b64d-4773-4776-b4dc-90341b55a129 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:16 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:16 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:16 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5205b64d-4773-4776-b4dc-90341b55a129 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5205b64d-4773-4776-b4dc-90341b55a129 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5205b64d-4773-4776-b4dc-90341b55a129 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:16 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:16 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:16 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b4b5f517-d6f3-4937-b9ae-9e2bc7e59c9c tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "cinder-92b01009-96a7-4c25-9fa7-3a43a77885a3-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b4b5f517-d6f3-4937-b9ae-9e2bc7e59c9c tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-92b01009-96a7-4c25-9fa7-3a43a77885a3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b4b5f517-d6f3-4937-b9ae-9e2bc7e59c9c tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "cinder-quobyte-92b01009-96a7-4c25-9fa7-3a43a77885a3" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:16 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00c107a2-a298-4227-beaa-7d46244f31eb" returned: 0 in 0.400s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.709s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2068361147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114f5745-1eae-4900-913f-b94fe6a7dad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e90439a9fe8f4c168ce63d7cc37482a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:11Z,use_quota=True,user_id='d8e42126b84c4fe5b9273cc120315fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:16 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Creating volume 114f5745-1eae-4900-913f-b94fe6a7dad2 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:16 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-114f5745-1eae-4900-913f-b94fe6a7dad2 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b4b5f517-d6f3-4937-b9ae-9e2bc7e59c9c tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-quobyte-92b01009-96a7-4c25-9fa7-3a43a77885a3" acquired by "delete_volume" :: waited 0.073s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:17 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-114f5745-1eae-4900-913f-b94fe6a7dad2 1073741824 Jul 14 13:15:17 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:17 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-60a52260-06cd-45e3-9600-20c032e7255d tempest-CreateVolumesFromImageTest-1320356657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.403s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-60a52260-06cd-45e3-9600-20c032e7255d tempest-CreateVolumesFromImageTest-1320356657 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9f8cb1-99bc-48e3-b281-2674b18f302e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00c107a2-a298-4227-beaa-7d46244f31eb', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6472311-787d-4887-becf-21c4ffdb4342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.524s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[873a21e5-9d26-48e0-a660-cefa9ac339ee]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b4b5f517-d6f3-4937-b9ae-9e2bc7e59c9c tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92b01009-96a7-4c25-9fa7-3a43a77885a3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:17 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-60a52260-06cd-45e3-9600-20c032e7255d tempest-CreateVolumesFromImageTest-1320356657 None] Deleted volume successfully. Jul 14 13:15:17 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD" returned: 1 in 0.590s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] a7ab245b-6dd6-48d3-a272-cf701cafe25c was raw, converting to raw {{(pid=86977) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1139}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:17 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Volume volume-00c107a2-a298-4227-beaa-7d46244f31eb (00c107a2-a298-4227-beaa-7d46244f31eb): created successfully Jul 14 13:15:17 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6472311-787d-4887-becf-21c4ffdb4342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Flow 'volume_create_manager' (ff0bef41-990d-460a-a9ad-a0cdcff550d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:17 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 Jul 14 13:15:17 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5205b64d-4773-4776-b4dc-90341b55a129 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.454s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-5205b64d-4773-4776-b4dc-90341b55a129 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-60a52260-06cd-45e3-9600-20c032e7255d tempest-CreateVolumesFromImageTest-1320356657 None] Lock "cinder-90452194-919d-49b3-8ed7-881b762f7c04-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:17 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-5205b64d-4773-4776-b4dc-90341b55a129 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Deleted volume successfully. Jul 14 13:15:17 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-676a406f-184d-4ba6-84d3-161c35ed68db tempest-CreateVolumesFromSnapshotTest-969137350 None] Created volume successfully. Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 29 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5205b64d-4773-4776-b4dc-90341b55a129 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-6ddc1af6-121e-4804-a832-99e07ff85ebf-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:17 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92b01009-96a7-4c25-9fa7-3a43a77885a3 Jul 14 13:15:17 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2a193830-db09-4580-a99b-62d5cdacfcf2 tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "cinder-6ce5fab1-fdd9-480b-a9eb-8d2be92393d5-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2a193830-db09-4580-a99b-62d5cdacfcf2 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "cinder-6ce5fab1-fdd9-480b-a9eb-8d2be92393d5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:17 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2a193830-db09-4580-a99b-62d5cdacfcf2 tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "cinder-quobyte-6ce5fab1-fdd9-480b-a9eb-8d2be92393d5" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9" returned: 0 in 0.447s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a7ab245b-6dd6-48d3-a272-cf701cafe25c_0w52ok16devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:15:17 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Converted 0.00 MB image at 0.00 MB/s Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:17 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-114f5745-1eae-4900-913f-b94fe6a7dad2 1073741824" returned: 0 in 0.595s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:17 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b4b5f517-d6f3-4937-b9ae-9e2bc7e59c9c tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92b01009-96a7-4c25-9fa7-3a43a77885a3" returned: 0 in 0.517s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b4b5f517-d6f3-4937-b9ae-9e2bc7e59c9c tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92b01009-96a7-4c25-9fa7-3a43a77885a3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:17 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 1G Jul 14 13:15:17 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2a193830-db09-4580-a99b-62d5cdacfcf2 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "cinder-quobyte-6ce5fab1-fdd9-480b-a9eb-8d2be92393d5" acquired by "delete_volume" :: waited 0.058s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:17 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92b01009-96a7-4c25-9fa7-3a43a77885a3 Jul 14 13:15:17 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[40426867-1442-4e4f-b73a-aaad593f864a]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2a193830-db09-4580-a99b-62d5cdacfcf2 tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ce5fab1-fdd9-480b-a9eb-8d2be92393d5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-114f5745-1eae-4900-913f-b94fe6a7dad2 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:17 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-114f5745-1eae-4900-913f-b94fe6a7dad2 Jul 14 13:15:17 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:17 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ce5fab1-fdd9-480b-a9eb-8d2be92393d5 Jul 14 13:15:17 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:17 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b4b5f517-d6f3-4937-b9ae-9e2bc7e59c9c tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-92b01009-96a7-4c25-9fa7-3a43a77885a3" returned: 0 in 0.320s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:17 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 1G" returned: 0 in 0.365s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:17 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b4b5f517-d6f3-4937-b9ae-9e2bc7e59c9c tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-quobyte-92b01009-96a7-4c25-9fa7-3a43a77885a3" released by "delete_volume" :: held 0.918s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-114f5745-1eae-4900-913f-b94fe6a7dad2" returned: 0 in 0.276s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.256s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1878454022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0565e852-a3f8-4aaa-952f-64ceb6002ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e90439a9fe8f4c168ce63d7cc37482a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:12Z,use_quota=True,user_id='d8e42126b84c4fe5b9273cc120315fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Creating volume 0565e852-a3f8-4aaa-952f-64ceb6002ec9 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:17 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0565e852-a3f8-4aaa-952f-64ceb6002ec9 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a03d44-65fe-4df1-9bd0-c986caa12e57]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:17 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0565e852-a3f8-4aaa-952f-64ceb6002ec9 1073741824 Jul 14 13:15:17 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452cc9e1-79a7-4a9f-9527-13a6072540a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114f5745-1eae-4900-913f-b94fe6a7dad2', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (976cd416-6de7-4b16-abed-3260c5118ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:18 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Volume volume-114f5745-1eae-4900-913f-b94fe6a7dad2 (114f5745-1eae-4900-913f-b94fe6a7dad2): created successfully Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (976cd416-6de7-4b16-abed-3260c5118ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Flow 'volume_create_manager' (35758f58-bab5-497e-973c-923f9f7a9560) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:18 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-7e56941a-9757-4bb6-8f9c-e6abc167bf9a tempest-CreateVolumesFromSnapshotTest-969137350 None] Created volume successfully. Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-b4b5f517-d6f3-4937-b9ae-9e2bc7e59c9c tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Created reservations ['e078cb13-63f9-4557-9bc9-8925be7db821', '163ae150-307c-45d5-989f-6104b04a6582', '169fb690-4839-49c5-8ad9-f90c1f1338f8', 'aca230ee-45b3-4d38-874a-fbe150c820fd'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:18 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2a193830-db09-4580-a99b-62d5cdacfcf2 tempest-CreateVolumesFromImageTest-1320356657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ce5fab1-fdd9-480b-a9eb-8d2be92393d5" returned: 0 in 0.466s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2a193830-db09-4580-a99b-62d5cdacfcf2 tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ce5fab1-fdd9-480b-a9eb-8d2be92393d5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:18 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 Jul 14 13:15:18 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:18 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ce5fab1-fdd9-480b-a9eb-8d2be92393d5 Jul 14 13:15:18 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b4b5f517-d6f3-4937-b9ae-9e2bc7e59c9c tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b4b5f517-d6f3-4937-b9ae-9e2bc7e59c9c tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b4b5f517-d6f3-4937-b9ae-9e2bc7e59c9c tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b4b5f517-d6f3-4937-b9ae-9e2bc7e59c9c tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b4b5f517-d6f3-4937-b9ae-9e2bc7e59c9c tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b4b5f517-d6f3-4937-b9ae-9e2bc7e59c9c tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:18 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:18 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:18 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2a193830-db09-4580-a99b-62d5cdacfcf2 tempest-CreateVolumesFromImageTest-1320356657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6ce5fab1-fdd9-480b-a9eb-8d2be92393d5" returned: 0 in 0.299s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:18 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2a193830-db09-4580-a99b-62d5cdacfcf2 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "cinder-quobyte-6ce5fab1-fdd9-480b-a9eb-8d2be92393d5" released by "delete_volume" :: held 0.821s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9" returned: 0 in 0.448s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:18 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0565e852-a3f8-4aaa-952f-64ceb6002ec9 1073741824" returned: 0 in 0.497s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:18 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b4b5f517-d6f3-4937-b9ae-9e2bc7e59c9c tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.293s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-b4b5f517-d6f3-4937-b9ae-9e2bc7e59c9c tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:18 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b4b5f517-d6f3-4937-b9ae-9e2bc7e59c9c tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Deleted volume successfully. Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0565e852-a3f8-4aaa-952f-64ceb6002ec9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-2a193830-db09-4580-a99b-62d5cdacfcf2 tempest-CreateVolumesFromImageTest-1320356657 None] Created reservations ['3fafee26-020e-4860-9625-0f294cdf095e', '981a8fa4-f89c-49df-8763-e4bd78518f44', 'e40d5ef3-624f-4282-8df3-f47236913135', '15da42b2-86af-4a02-a9a8-a96284b22d74'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:18 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0565e852-a3f8-4aaa-952f-64ceb6002ec9 Jul 14 13:15:18 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b4b5f517-d6f3-4937-b9ae-9e2bc7e59c9c tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-92b01009-96a7-4c25-9fa7-3a43a77885a3-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:18 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 Jul 14 13:15:18 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2a193830-db09-4580-a99b-62d5cdacfcf2 tempest-CreateVolumesFromImageTest-1320356657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2a193830-db09-4580-a99b-62d5cdacfcf2 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2a193830-db09-4580-a99b-62d5cdacfcf2 tempest-CreateVolumesFromImageTest-1320356657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2a193830-db09-4580-a99b-62d5cdacfcf2 tempest-CreateVolumesFromImageTest-1320356657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2a193830-db09-4580-a99b-62d5cdacfcf2 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2a193830-db09-4580-a99b-62d5cdacfcf2 tempest-CreateVolumesFromImageTest-1320356657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:18 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:18 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:18 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0565e852-a3f8-4aaa-952f-64ceb6002ec9" returned: 0 in 0.320s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.597s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1058250461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b12001-f957-4eaa-9fe1-17cae9826c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e90439a9fe8f4c168ce63d7cc37482a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:12Z,use_quota=True,user_id='d8e42126b84c4fe5b9273cc120315fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Creating volume c2b12001-f957-4eaa-9fe1-17cae9826c34 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:18 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:18 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c2b12001-f957-4eaa-9fe1-17cae9826c34 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9" returned: 1 in 0.477s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Downloaded image a7ab245b-6dd6-48d3-a272-cf701cafe25c ((None, [{'url': 'file:///opt/stack/data/glance/images/a7ab245b-6dd6-48d3-a272-cf701cafe25c', 'metadata': {}}])) to volume be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 successfully. {{(pid=86977) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Temporary image a7ab245b-6dd6-48d3-a272-cf701cafe25c for user ebb957e3f7a1469ca73222a79819ea41 is deleted. {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:1454}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Marking volume be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 as bootable. {{(pid=86977) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 13:15:18 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c2b12001-f957-4eaa-9fe1-17cae9826c34 1073741824 Jul 14 13:15:18 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69d1a30-751a-4571-8192-a41a455d3a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0565e852-a3f8-4aaa-952f-64ceb6002ec9', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff5fda1-bcd7-4f48-a2a8-21f970435845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Copying metadata from image a7ab245b-6dd6-48d3-a272-cf701cafe25c to be32a5fc-31f5-478f-85fb-ab87d4b1e5a9. {{(pid=86977) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Creating volume glance metadata for volume be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 backed by image a7ab245b-6dd6-48d3-a272-cf701cafe25c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a7ab245b-6dd6-48d3-a272-cf701cafe25c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '956e859d9e68d99eb2e26fc5c0117ec8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86977) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 13:15:18 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Volume volume-0565e852-a3f8-4aaa-952f-64ceb6002ec9 (0565e852-a3f8-4aaa-952f-64ceb6002ec9): created successfully Jul 14 13:15:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff5fda1-bcd7-4f48-a2a8-21f970435845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Flow 'volume_create_manager' (624a7db0-b243-44a1-acda-2c0dae1bffb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:19 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2a193830-db09-4580-a99b-62d5cdacfcf2 tempest-CreateVolumesFromImageTest-1320356657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.333s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-2a193830-db09-4580-a99b-62d5cdacfcf2 tempest-CreateVolumesFromImageTest-1320356657 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:19 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-2a193830-db09-4580-a99b-62d5cdacfcf2 tempest-CreateVolumesFromImageTest-1320356657 None] Deleted volume successfully. Jul 14 13:15:19 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-89f1ddb5-4b0d-4def-b97f-514f65a27be6 tempest-CreateVolumesFromSnapshotTest-969137350 None] Created volume successfully. Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2a193830-db09-4580-a99b-62d5cdacfcf2 tempest-CreateVolumesFromImageTest-1320356657 None] Lock "cinder-6ce5fab1-fdd9-480b-a9eb-8d2be92393d5-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ceceb90-e2ee-46d8-bcde-302348968fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9', 'volume_size': 1, 'image_id': 'a7ab245b-6dd6-48d3-a272-cf701cafe25c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7ab245b-6dd6-48d3-a272-cf701cafe25c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '956e859d9e68d99eb2e26fc5c0117ec8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a0ab3fb59cbb444a883f500a93370a9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a2a561b813c399aefa2d98a64ee876c04a9f563d49c1be92d208d0da1ad4a320fa831a2a7de6a018279bde10cf5296e097c2cef5cf8715702720a6e196f8cca', 'id': 'a7ab245b-6dd6-48d3-a272-cf701cafe25c', 'created_at': datetime.datetime(2026, 7, 14, 11, 15, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 11, 15, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7ab245b-6dd6-48d3-a272-cf701cafe25c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866f3874-f2c1-4f52-a46e-9e015c872a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e08f7ee6-47c7-43f0-9c2a-26561ed7bdd6 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "cinder-0761e1e3-1264-496f-aba7-43831599a4eb-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:19 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Volume volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 (be32a5fc-31f5-478f-85fb-ab87d4b1e5a9): created successfully Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866f3874-f2c1-4f52-a46e-9e015c872a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Flow 'volume_create_manager' (e39be2c7-ac97-468a-bc36-3586cbb1d6c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:19 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-197bf990-c4f8-42cb-ac94-83dde81a2322 tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Created volume successfully. Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e08f7ee6-47c7-43f0-9c2a-26561ed7bdd6 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-0761e1e3-1264-496f-aba7-43831599a4eb-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e08f7ee6-47c7-43f0-9c2a-26561ed7bdd6 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "cinder-quobyte-0761e1e3-1264-496f-aba7-43831599a4eb" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e08f7ee6-47c7-43f0-9c2a-26561ed7bdd6 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-quobyte-0761e1e3-1264-496f-aba7-43831599a4eb" acquired by "delete_volume" :: waited 0.015s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[c900738f-86ac-4256-9560-91cc02f928c0]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e08f7ee6-47c7-43f0-9c2a-26561ed7bdd6 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0761e1e3-1264-496f-aba7-43831599a4eb {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:19 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0761e1e3-1264-496f-aba7-43831599a4eb Jul 14 13:15:19 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:19 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c2b12001-f957-4eaa-9fe1-17cae9826c34 1073741824" returned: 0 in 0.598s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c2b12001-f957-4eaa-9fe1-17cae9826c34 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:19 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c2b12001-f957-4eaa-9fe1-17cae9826c34 Jul 14 13:15:19 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:19 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e08f7ee6-47c7-43f0-9c2a-26561ed7bdd6 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0761e1e3-1264-496f-aba7-43831599a4eb" returned: 0 in 0.473s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e08f7ee6-47c7-43f0-9c2a-26561ed7bdd6 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0761e1e3-1264-496f-aba7-43831599a4eb {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:19 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0761e1e3-1264-496f-aba7-43831599a4eb Jul 14 13:15:19 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:19 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c2b12001-f957-4eaa-9fe1-17cae9826c34" returned: 0 in 0.306s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f72514-a901-4fb6-a682-1578e1e53e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2b12001-f957-4eaa-9fe1-17cae9826c34', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b9d97e0-71a1-407e-80ce-c233faf0c01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:19 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Volume volume-c2b12001-f957-4eaa-9fe1-17cae9826c34 (c2b12001-f957-4eaa-9fe1-17cae9826c34): created successfully Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b9d97e0-71a1-407e-80ce-c233faf0c01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:19 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Flow 'volume_create_manager' (713a0d2a-233a-4b9f-b4f7-7cf952cbf835) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:19 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-8b551381-931c-422d-9b91-92c568a06c0b tempest-CreateVolumesFromSnapshotTest-969137350 None] Created volume successfully. Jul 14 13:15:20 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e08f7ee6-47c7-43f0-9c2a-26561ed7bdd6 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0761e1e3-1264-496f-aba7-43831599a4eb" returned: 0 in 0.281s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e08f7ee6-47c7-43f0-9c2a-26561ed7bdd6 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-quobyte-0761e1e3-1264-496f-aba7-43831599a4eb" released by "delete_volume" :: held 0.808s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Acquiring lock "cinder-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-e08f7ee6-47c7-43f0-9c2a-26561ed7bdd6 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Created reservations ['901ea886-39c1-4569-aa86-b6b2f4298c7d', 'e5366cc4-86a8-497f-90ec-3a4d435a438b', '3a94a472-8f8f-4da7-ba2e-bc155d987f26', '5d6fdd12-5d38-429c-976b-8db136515fc7'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Lock "cinder-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Acquiring lock "cinder-quobyte-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Lock "cinder-quobyte-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9" acquired by "delete_volume" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e08f7ee6-47c7-43f0-9c2a-26561ed7bdd6 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e08f7ee6-47c7-43f0-9c2a-26561ed7bdd6 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e08f7ee6-47c7-43f0-9c2a-26561ed7bdd6 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e08f7ee6-47c7-43f0-9c2a-26561ed7bdd6 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e08f7ee6-47c7-43f0-9c2a-26561ed7bdd6 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e08f7ee6-47c7-43f0-9c2a-26561ed7bdd6 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a5c8ef-358c-451f-a617-4e816719605a]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:20 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:20 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fb04ef63-2053-4d41-bbb4-9fa4f9a6a8ad tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "cinder-562ffe7e-843d-4f74-9ce7-6d52f9144314-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fb04ef63-2053-4d41-bbb4-9fa4f9a6a8ad tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-562ffe7e-843d-4f74-9ce7-6d52f9144314-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:20 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 Jul 14 13:15:20 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fb04ef63-2053-4d41-bbb4-9fa4f9a6a8ad tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "cinder-quobyte-562ffe7e-843d-4f74-9ce7-6d52f9144314" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fb04ef63-2053-4d41-bbb4-9fa4f9a6a8ad tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-quobyte-562ffe7e-843d-4f74-9ce7-6d52f9144314" acquired by "delete_volume" :: waited 0.027s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab780bc-66cf-49fc-bd31-9a6d50cf93f1]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fb04ef63-2053-4d41-bbb4-9fa4f9a6a8ad tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-562ffe7e-843d-4f74-9ce7-6d52f9144314 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:20 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e08f7ee6-47c7-43f0-9c2a-26561ed7bdd6 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.360s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-e08f7ee6-47c7-43f0-9c2a-26561ed7bdd6 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:20 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e08f7ee6-47c7-43f0-9c2a-26561ed7bdd6 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Deleted volume successfully. Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e08f7ee6-47c7-43f0-9c2a-26561ed7bdd6 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-0761e1e3-1264-496f-aba7-43831599a4eb-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:20 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-562ffe7e-843d-4f74-9ce7-6d52f9144314 Jul 14 13:15:20 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:20 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9" returned: 0 in 0.440s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:20 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 Jul 14 13:15:20 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6d4862b1-bdcf-46c3-b8bc-1f8b0a822052 tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "cinder-c2b12001-f957-4eaa-9fe1-17cae9826c34-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6d4862b1-bdcf-46c3-b8bc-1f8b0a822052 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-c2b12001-f957-4eaa-9fe1-17cae9826c34-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6d4862b1-bdcf-46c3-b8bc-1f8b0a822052 tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "cinder-quobyte-c2b12001-f957-4eaa-9fe1-17cae9826c34" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6d4862b1-bdcf-46c3-b8bc-1f8b0a822052 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-quobyte-c2b12001-f957-4eaa-9fe1-17cae9826c34" acquired by "delete_volume" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9760b6d-2f0c-4e0f-bb61-47e10be53fc8]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d4862b1-bdcf-46c3-b8bc-1f8b0a822052 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c2b12001-f957-4eaa-9fe1-17cae9826c34 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:21 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fb04ef63-2053-4d41-bbb4-9fa4f9a6a8ad tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-562ffe7e-843d-4f74-9ce7-6d52f9144314" returned: 0 in 0.587s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fb04ef63-2053-4d41-bbb4-9fa4f9a6a8ad tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-562ffe7e-843d-4f74-9ce7-6d52f9144314 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:21 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-562ffe7e-843d-4f74-9ce7-6d52f9144314 Jul 14 13:15:21 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:21 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c2b12001-f957-4eaa-9fe1-17cae9826c34 Jul 14 13:15:21 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:21 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9" returned: 1 in 0.499s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:21 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9 Jul 14 13:15:21 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:21 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fb04ef63-2053-4d41-bbb4-9fa4f9a6a8ad tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-562ffe7e-843d-4f74-9ce7-6d52f9144314" returned: 0 in 0.363s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:21 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d4862b1-bdcf-46c3-b8bc-1f8b0a822052 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c2b12001-f957-4eaa-9fe1-17cae9826c34" returned: 0 in 0.469s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d4862b1-bdcf-46c3-b8bc-1f8b0a822052 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c2b12001-f957-4eaa-9fe1-17cae9826c34 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fb04ef63-2053-4d41-bbb4-9fa4f9a6a8ad tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-quobyte-562ffe7e-843d-4f74-9ce7-6d52f9144314" released by "delete_volume" :: held 1.030s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:21 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c2b12001-f957-4eaa-9fe1-17cae9826c34 Jul 14 13:15:21 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:21 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9" returned: 0 in 0.327s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Lock "cinder-quobyte-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9" released by "delete_volume" :: held 1.357s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-fb04ef63-2053-4d41-bbb4-9fa4f9a6a8ad tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Created reservations ['20317294-54cf-4217-860e-a04aa7f980c1', '0d74edfe-bb5b-45df-b3ee-2c16535eb06c', '1326ab55-ab2b-4616-82d3-3f084c289f09', '431f612a-6c1a-4544-8b7a-faf2c6516839'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Created reservations ['ff9bcd80-b223-46a8-b315-272ab60f98de', '00825200-21b3-43d6-bee9-98a1edd12d29', 'fa2a01f5-2e7f-4de0-b7aa-b613b152cf50', '6d18d486-c674-46bc-a6ab-1675a5b8be56'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fb04ef63-2053-4d41-bbb4-9fa4f9a6a8ad tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fb04ef63-2053-4d41-bbb4-9fa4f9a6a8ad tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fb04ef63-2053-4d41-bbb4-9fa4f9a6a8ad tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fb04ef63-2053-4d41-bbb4-9fa4f9a6a8ad tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fb04ef63-2053-4d41-bbb4-9fa4f9a6a8ad tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fb04ef63-2053-4d41-bbb4-9fa4f9a6a8ad tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:21 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:21 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:21 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:21 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:21 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d4862b1-bdcf-46c3-b8bc-1f8b0a822052 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c2b12001-f957-4eaa-9fe1-17cae9826c34" returned: 0 in 0.320s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6d4862b1-bdcf-46c3-b8bc-1f8b0a822052 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-quobyte-c2b12001-f957-4eaa-9fe1-17cae9826c34" released by "delete_volume" :: held 0.852s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-6d4862b1-bdcf-46c3-b8bc-1f8b0a822052 tempest-CreateVolumesFromSnapshotTest-969137350 None] Created reservations ['612713ac-202e-4f60-8980-3d835d58d135', '46c4dcd9-513b-4f8b-b7cf-bc7c353fd8f9', 'a7dfbf04-a6a9-4749-96d5-6167f11f1330', 'df462546-fe4a-4dc4-9133-fab86a61f65f'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6d4862b1-bdcf-46c3-b8bc-1f8b0a822052 tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6d4862b1-bdcf-46c3-b8bc-1f8b0a822052 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6d4862b1-bdcf-46c3-b8bc-1f8b0a822052 tempest-CreateVolumesFromSnapshotTest-969137350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6d4862b1-bdcf-46c3-b8bc-1f8b0a822052 tempest-CreateVolumesFromSnapshotTest-969137350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6d4862b1-bdcf-46c3-b8bc-1f8b0a822052 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d4862b1-bdcf-46c3-b8bc-1f8b0a822052 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:22 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:22 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:22 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fb04ef63-2053-4d41-bbb4-9fa4f9a6a8ad tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.326s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-fb04ef63-2053-4d41-bbb4-9fa4f9a6a8ad tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:22 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-fb04ef63-2053-4d41-bbb4-9fa4f9a6a8ad tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Deleted volume successfully. Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fb04ef63-2053-4d41-bbb4-9fa4f9a6a8ad tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-562ffe7e-843d-4f74-9ce7-6d52f9144314-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:22 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-04a4be3c-b5f0-4a37-acdf-97239756a9c8 tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "cinder-0565e852-a3f8-4aaa-952f-64ceb6002ec9-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.341s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:22 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Deleted volume successfully. Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-04a4be3c-b5f0-4a37-acdf-97239756a9c8 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-0565e852-a3f8-4aaa-952f-64ceb6002ec9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2b769072-3889-4e6f-b2c5-ab310eea334f tempest-VolumeAndVolumeTypeFromImageTest-1573312437 None] Lock "cinder-be32a5fc-31f5-478f-85fb-ab87d4b1e5a9-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-04a4be3c-b5f0-4a37-acdf-97239756a9c8 tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "cinder-quobyte-0565e852-a3f8-4aaa-952f-64ceb6002ec9" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-04a4be3c-b5f0-4a37-acdf-97239756a9c8 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-quobyte-0565e852-a3f8-4aaa-952f-64ceb6002ec9" acquired by "delete_volume" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[df94856c-3a75-433d-80cd-40cda82d395d]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-04a4be3c-b5f0-4a37-acdf-97239756a9c8 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0565e852-a3f8-4aaa-952f-64ceb6002ec9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:22 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:22 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0565e852-a3f8-4aaa-952f-64ceb6002ec9 Jul 14 13:15:22 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6d4862b1-bdcf-46c3-b8bc-1f8b0a822052 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.393s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-6d4862b1-bdcf-46c3-b8bc-1f8b0a822052 tempest-CreateVolumesFromSnapshotTest-969137350 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:22 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-6d4862b1-bdcf-46c3-b8bc-1f8b0a822052 tempest-CreateVolumesFromSnapshotTest-969137350 None] Deleted volume successfully. Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6d4862b1-bdcf-46c3-b8bc-1f8b0a822052 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-c2b12001-f957-4eaa-9fe1-17cae9826c34-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-41376cb4-7ab8-478c-951c-6beee3396cae tempest-ProjectAdminTests-600144678 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86977) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 14 13:15:22 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-04a4be3c-b5f0-4a37-acdf-97239756a9c8 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0565e852-a3f8-4aaa-952f-64ceb6002ec9" returned: 0 in 0.452s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-04a4be3c-b5f0-4a37-acdf-97239756a9c8 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0565e852-a3f8-4aaa-952f-64ceb6002ec9 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:22 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0565e852-a3f8-4aaa-952f-64ceb6002ec9 Jul 14 13:15:22 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d356fe3f-9e2b-4750-885c-a5f2aeae67c1 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "cinder-dfb8456d-a30b-4d8e-a1c7-3464cad8182a-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d356fe3f-9e2b-4750-885c-a5f2aeae67c1 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-dfb8456d-a30b-4d8e-a1c7-3464cad8182a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d356fe3f-9e2b-4750-885c-a5f2aeae67c1 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "cinder-quobyte-dfb8456d-a30b-4d8e-a1c7-3464cad8182a" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d356fe3f-9e2b-4750-885c-a5f2aeae67c1 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-quobyte-dfb8456d-a30b-4d8e-a1c7-3464cad8182a" acquired by "delete_volume" :: waited 0.028s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d54e1b9-131b-43ab-98c3-3c0e156ef2fb]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d356fe3f-9e2b-4750-885c-a5f2aeae67c1 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfb8456d-a30b-4d8e-a1c7-3464cad8182a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:23 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfb8456d-a30b-4d8e-a1c7-3464cad8182a Jul 14 13:15:23 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:23 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-04a4be3c-b5f0-4a37-acdf-97239756a9c8 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0565e852-a3f8-4aaa-952f-64ceb6002ec9" returned: 0 in 0.357s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-04a4be3c-b5f0-4a37-acdf-97239756a9c8 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-quobyte-0565e852-a3f8-4aaa-952f-64ceb6002ec9" released by "delete_volume" :: held 0.859s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-04a4be3c-b5f0-4a37-acdf-97239756a9c8 tempest-CreateVolumesFromSnapshotTest-969137350 None] Created reservations ['4d2174d9-52a6-4281-912a-2b56ed52d665', 'a5046735-083d-4156-bfee-14cacb3447c5', '26b426ca-49db-4236-ba43-992fa2840012', '8c9306de-8de4-4f70-913b-021ff31a4388'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-04a4be3c-b5f0-4a37-acdf-97239756a9c8 tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-04a4be3c-b5f0-4a37-acdf-97239756a9c8 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-04a4be3c-b5f0-4a37-acdf-97239756a9c8 tempest-CreateVolumesFromSnapshotTest-969137350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-04a4be3c-b5f0-4a37-acdf-97239756a9c8 tempest-CreateVolumesFromSnapshotTest-969137350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-04a4be3c-b5f0-4a37-acdf-97239756a9c8 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-04a4be3c-b5f0-4a37-acdf-97239756a9c8 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:23 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:23 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d2e9a3f8-eb8f-4221-8004-af0413459dfa tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "cinder-114f5745-1eae-4900-913f-b94fe6a7dad2-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d2e9a3f8-eb8f-4221-8004-af0413459dfa tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-114f5745-1eae-4900-913f-b94fe6a7dad2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:23 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d2e9a3f8-eb8f-4221-8004-af0413459dfa tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "cinder-quobyte-114f5745-1eae-4900-913f-b94fe6a7dad2" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d356fe3f-9e2b-4750-885c-a5f2aeae67c1 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfb8456d-a30b-4d8e-a1c7-3464cad8182a" returned: 0 in 0.555s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d356fe3f-9e2b-4750-885c-a5f2aeae67c1 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfb8456d-a30b-4d8e-a1c7-3464cad8182a {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d2e9a3f8-eb8f-4221-8004-af0413459dfa tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-quobyte-114f5745-1eae-4900-913f-b94fe6a7dad2" acquired by "delete_volume" :: waited 0.047s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:23 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfb8456d-a30b-4d8e-a1c7-3464cad8182a Jul 14 13:15:23 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ebc993-ecf3-4eb7-b4fe-c375ef40fdbd]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d2e9a3f8-eb8f-4221-8004-af0413459dfa tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-114f5745-1eae-4900-913f-b94fe6a7dad2 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:23 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-04a4be3c-b5f0-4a37-acdf-97239756a9c8 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.333s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-04a4be3c-b5f0-4a37-acdf-97239756a9c8 tempest-CreateVolumesFromSnapshotTest-969137350 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:23 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-04a4be3c-b5f0-4a37-acdf-97239756a9c8 tempest-CreateVolumesFromSnapshotTest-969137350 None] Deleted volume successfully. Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-04a4be3c-b5f0-4a37-acdf-97239756a9c8 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-0565e852-a3f8-4aaa-952f-64ceb6002ec9-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:23 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-114f5745-1eae-4900-913f-b94fe6a7dad2 Jul 14 13:15:23 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:23 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d356fe3f-9e2b-4750-885c-a5f2aeae67c1 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dfb8456d-a30b-4d8e-a1c7-3464cad8182a" returned: 0 in 0.351s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d356fe3f-9e2b-4750-885c-a5f2aeae67c1 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-quobyte-dfb8456d-a30b-4d8e-a1c7-3464cad8182a" released by "delete_volume" :: held 0.968s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:23 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-d356fe3f-9e2b-4750-885c-a5f2aeae67c1 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Created reservations ['d12cc1f2-21f5-499b-ad31-deaf32c7730b', '33847204-c1fa-4e77-afa6-9086fa17a55b', '72320dac-6531-401d-bfff-8ccab6a258a5', 'd74a352a-8d0c-4253-ae9a-da6c6984ddfc'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d356fe3f-9e2b-4750-885c-a5f2aeae67c1 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d356fe3f-9e2b-4750-885c-a5f2aeae67c1 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d356fe3f-9e2b-4750-885c-a5f2aeae67c1 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:24 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d356fe3f-9e2b-4750-885c-a5f2aeae67c1 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d356fe3f-9e2b-4750-885c-a5f2aeae67c1 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d356fe3f-9e2b-4750-885c-a5f2aeae67c1 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d2e9a3f8-eb8f-4221-8004-af0413459dfa tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-114f5745-1eae-4900-913f-b94fe6a7dad2" returned: 0 in 0.560s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d2e9a3f8-eb8f-4221-8004-af0413459dfa tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-114f5745-1eae-4900-913f-b94fe6a7dad2 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:24 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:24 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:24 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-114f5745-1eae-4900-913f-b94fe6a7dad2 Jul 14 13:15:24 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:24 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d356fe3f-9e2b-4750-885c-a5f2aeae67c1 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.289s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:24 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-d356fe3f-9e2b-4750-885c-a5f2aeae67c1 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:24 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-d356fe3f-9e2b-4750-885c-a5f2aeae67c1 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Deleted volume successfully. Jul 14 13:15:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d356fe3f-9e2b-4750-885c-a5f2aeae67c1 tempest-CreateVolumesFromSourceVolumeTest-218692769 None] Lock "cinder-dfb8456d-a30b-4d8e-a1c7-3464cad8182a-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:24 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d2e9a3f8-eb8f-4221-8004-af0413459dfa tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-114f5745-1eae-4900-913f-b94fe6a7dad2" returned: 0 in 0.389s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:24 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d2e9a3f8-eb8f-4221-8004-af0413459dfa tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-quobyte-114f5745-1eae-4900-913f-b94fe6a7dad2" released by "delete_volume" :: held 1.016s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:24 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-d2e9a3f8-eb8f-4221-8004-af0413459dfa tempest-CreateVolumesFromSnapshotTest-969137350 None] Created reservations ['4cbbf686-09c7-4962-a5ee-11177c0c5d54', 'ac561341-f254-4501-819a-a12c161009f0', '2054a59a-645a-40fd-bae6-e8301bf65213', 'aa8667c6-1629-48fb-b2a7-77b026235967'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d2e9a3f8-eb8f-4221-8004-af0413459dfa tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d2e9a3f8-eb8f-4221-8004-af0413459dfa tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d2e9a3f8-eb8f-4221-8004-af0413459dfa tempest-CreateVolumesFromSnapshotTest-969137350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-d2e9a3f8-eb8f-4221-8004-af0413459dfa tempest-CreateVolumesFromSnapshotTest-969137350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-d2e9a3f8-eb8f-4221-8004-af0413459dfa tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d2e9a3f8-eb8f-4221-8004-af0413459dfa tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:24 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:24 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:25 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d2e9a3f8-eb8f-4221-8004-af0413459dfa tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.281s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:25 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-d2e9a3f8-eb8f-4221-8004-af0413459dfa tempest-CreateVolumesFromSnapshotTest-969137350 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:25 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-d2e9a3f8-eb8f-4221-8004-af0413459dfa tempest-CreateVolumesFromSnapshotTest-969137350 None] Deleted volume successfully. Jul 14 13:15:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d2e9a3f8-eb8f-4221-8004-af0413459dfa tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-114f5745-1eae-4900-913f-b94fe6a7dad2-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6e602b68-3498-4577-864f-18b8a35986ae tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "cinder-00c107a2-a298-4227-beaa-7d46244f31eb-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6e602b68-3498-4577-864f-18b8a35986ae tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-00c107a2-a298-4227-beaa-7d46244f31eb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6e602b68-3498-4577-864f-18b8a35986ae tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "cinder-quobyte-00c107a2-a298-4227-beaa-7d46244f31eb" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:25 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6e602b68-3498-4577-864f-18b8a35986ae tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-quobyte-00c107a2-a298-4227-beaa-7d46244f31eb" acquired by "delete_volume" :: waited 0.031s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:25 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[35aef1ff-4dac-411f-98f5-80f935fcaf75]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6e602b68-3498-4577-864f-18b8a35986ae tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00c107a2-a298-4227-beaa-7d46244f31eb {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:26 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00c107a2-a298-4227-beaa-7d46244f31eb Jul 14 13:15:26 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:26 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6e602b68-3498-4577-864f-18b8a35986ae tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00c107a2-a298-4227-beaa-7d46244f31eb" returned: 0 in 0.481s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6e602b68-3498-4577-864f-18b8a35986ae tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00c107a2-a298-4227-beaa-7d46244f31eb {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:26 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00c107a2-a298-4227-beaa-7d46244f31eb Jul 14 13:15:26 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:26 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6e602b68-3498-4577-864f-18b8a35986ae tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-00c107a2-a298-4227-beaa-7d46244f31eb" returned: 0 in 0.342s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:26 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6e602b68-3498-4577-864f-18b8a35986ae tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-quobyte-00c107a2-a298-4227-beaa-7d46244f31eb" released by "delete_volume" :: held 0.886s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:26 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-6e602b68-3498-4577-864f-18b8a35986ae tempest-CreateVolumesFromSnapshotTest-969137350 None] Created reservations ['2b854470-d140-4e19-8181-52d9217e9881', '2e2aadd9-e149-4210-b8dd-9c3cbbba9057', 'b1af4eab-bb22-4ffc-9627-b2651d41159c', '96129dce-488a-4f32-85fb-33cee043afa2'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6e602b68-3498-4577-864f-18b8a35986ae tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6e602b68-3498-4577-864f-18b8a35986ae tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:26 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6e602b68-3498-4577-864f-18b8a35986ae tempest-CreateVolumesFromSnapshotTest-969137350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:26 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6e602b68-3498-4577-864f-18b8a35986ae tempest-CreateVolumesFromSnapshotTest-969137350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6e602b68-3498-4577-864f-18b8a35986ae tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6e602b68-3498-4577-864f-18b8a35986ae tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:27 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:27 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:27 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6e602b68-3498-4577-864f-18b8a35986ae tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.272s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:27 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-6e602b68-3498-4577-864f-18b8a35986ae tempest-CreateVolumesFromSnapshotTest-969137350 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:27 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-6e602b68-3498-4577-864f-18b8a35986ae tempest-CreateVolumesFromSnapshotTest-969137350 None] Deleted volume successfully. Jul 14 13:15:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6e602b68-3498-4577-864f-18b8a35986ae tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-00c107a2-a298-4227-beaa-7d46244f31eb-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:27 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Flow 'volume_create_manager' (83ab7feb-c4e7-4a7f-a94d-e40035e4e82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4386b6-3070-4aa7-b5b4-51a0594dd241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4386b6-3070-4aa7-b5b4-51a0594dd241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-204961460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2569a11-01a2-4ee9-95eb-bcdf47b37a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ce77d922d74f64be5aceab89b43e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:28Z,use_quota=True,user_id='a8d39912638c4ab594816189250d21e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a400a10a-20f0-4f14-a762-546039553280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a400a10a-20f0-4f14-a762-546039553280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd650f7-329f-4c4e-87ab-18dd7f42c876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd650f7-329f-4c4e-87ab-18dd7f42c876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2569a11-01a2-4ee9-95eb-bcdf47b37a81', 'volume_name': 'volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c462a138-ade0-413c-9264-d0e0d72da09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c462a138-ade0-413c-9264-d0e0d72da09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (016792f7-22bb-4ba4-aa28-6fd58f7e6dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:28 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Volume a2569a11-01a2-4ee9-95eb-bcdf47b37a81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81', 'volume_size': 1} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-204961460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2569a11-01a2-4ee9-95eb-bcdf47b37a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ce77d922d74f64be5aceab89b43e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:28Z,use_quota=True,user_id='a8d39912638c4ab594816189250d21e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Creating volume a2569a11-01a2-4ee9-95eb-bcdf47b37a81 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:28 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c5103936-aa27-4f60-8b81-e0b8ff3ab315 tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "cinder-e6a332e4-a1ee-4c98-8c1f-3250439db420-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c5103936-aa27-4f60-8b81-e0b8ff3ab315 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-e6a332e4-a1ee-4c98-8c1f-3250439db420-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:28 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81 1073741824 Jul 14 13:15:28 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c5103936-aa27-4f60-8b81-e0b8ff3ab315 tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "cinder-quobyte-e6a332e4-a1ee-4c98-8c1f-3250439db420" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c5103936-aa27-4f60-8b81-e0b8ff3ab315 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-quobyte-e6a332e4-a1ee-4c98-8c1f-3250439db420" acquired by "delete_volume" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[c978a4e3-69d2-4ac7-9c9e-83a09d49114c]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5103936-aa27-4f60-8b81-e0b8ff3ab315 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e6a332e4-a1ee-4c98-8c1f-3250439db420 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:28 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e6a332e4-a1ee-4c98-8c1f-3250439db420 Jul 14 13:15:28 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Flow 'volume_create_manager' (eb95a0e6-4e3c-4b35-b79f-ffcf3f5a7c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6821259-ba4b-415c-b203-ffa0a5442e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6821259-ba4b-415c-b203-ffa0a5442e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-742006024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=891c8bb2-091a-4f6a-836f-b89120611f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7a59e8fae740889138f23ecc2c9925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:29Z,use_quota=True,user_id='e1cf14ad749c4053a046915faab35e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f13501-1cc5-454d-9a97-80dead7fa99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f13501-1cc5-454d-9a97-80dead7fa99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ecdb145-7bb3-4c41-961b-9c7cbfa90774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ecdb145-7bb3-4c41-961b-9c7cbfa90774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '891c8bb2-091a-4f6a-836f-b89120611f97', 'volume_name': 'volume-891c8bb2-091a-4f6a-836f-b89120611f97', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (557c6808-40bc-4d95-a21d-550460a50903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (557c6808-40bc-4d95-a21d-550460a50903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66ecc527-be92-46d1-81ba-eb46705db688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:28 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Volume 891c8bb2-091a-4f6a-836f-b89120611f97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-891c8bb2-091a-4f6a-836f-b89120611f97', 'volume_size': 1} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:28 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81 1073741824" returned: 0 in 0.599s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:28 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5103936-aa27-4f60-8b81-e0b8ff3ab315 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e6a332e4-a1ee-4c98-8c1f-3250439db420" returned: 0 in 0.524s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5103936-aa27-4f60-8b81-e0b8ff3ab315 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e6a332e4-a1ee-4c98-8c1f-3250439db420 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:28 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81 Jul 14 13:15:28 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:28 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e6a332e4-a1ee-4c98-8c1f-3250439db420 Jul 14 13:15:28 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:29 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81" returned: 0 in 0.252s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.369s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-742006024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=891c8bb2-091a-4f6a-836f-b89120611f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7a59e8fae740889138f23ecc2c9925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:29Z,use_quota=True,user_id='e1cf14ad749c4053a046915faab35e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Creating volume 891c8bb2-091a-4f6a-836f-b89120611f97 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:29 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (016792f7-22bb-4ba4-aa28-6fd58f7e6dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:29 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97 1073741824 Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4259dbb9-6467-4e4f-b171-8094914a3b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:29 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:29 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5103936-aa27-4f60-8b81-e0b8ff3ab315 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e6a332e4-a1ee-4c98-8c1f-3250439db420" returned: 0 in 0.286s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:29 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Volume volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81 (a2569a11-01a2-4ee9-95eb-bcdf47b37a81): created successfully Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4259dbb9-6467-4e4f-b171-8094914a3b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Flow 'volume_create_manager' (83ab7feb-c4e7-4a7f-a94d-e40035e4e82d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c5103936-aa27-4f60-8b81-e0b8ff3ab315 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-quobyte-e6a332e4-a1ee-4c98-8c1f-3250439db420" released by "delete_volume" :: held 0.884s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:29 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-3d7e2253-8189-4cb0-9d17-bcb487a887a1 tempest-ProjectMemberTests-1712779975 None] Created volume successfully. Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-c5103936-aa27-4f60-8b81-e0b8ff3ab315 tempest-CreateVolumesFromSnapshotTest-969137350 None] Created reservations ['5db41af0-81ee-488b-ac14-0c99120a8bb6', 'e6325b8f-1891-4c0f-8c19-7af3c0ef251c', '820f3318-698a-47b1-a5fa-72d4b67ffb58', '629afe39-ba35-4302-b7fe-d47083fe81d6'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c5103936-aa27-4f60-8b81-e0b8ff3ab315 tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c5103936-aa27-4f60-8b81-e0b8ff3ab315 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c5103936-aa27-4f60-8b81-e0b8ff3ab315 tempest-CreateVolumesFromSnapshotTest-969137350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c5103936-aa27-4f60-8b81-e0b8ff3ab315 tempest-CreateVolumesFromSnapshotTest-969137350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c5103936-aa27-4f60-8b81-e0b8ff3ab315 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5103936-aa27-4f60-8b81-e0b8ff3ab315 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:29 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:29 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bdb9f60c-185c-499a-a816-93899bb383ee tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "cinder-cf98b4af-1746-4cdc-aad5-de9a328b9cdb-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bdb9f60c-185c-499a-a816-93899bb383ee tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-cf98b4af-1746-4cdc-aad5-de9a328b9cdb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bdb9f60c-185c-499a-a816-93899bb383ee tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "cinder-quobyte-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bdb9f60c-185c-499a-a816-93899bb383ee tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-quobyte-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bdb9f60c-185c-499a-a816-93899bb383ee tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "cinder-quobyte-cf98b4af-1746-4cdc-aad5-de9a328b9cdb" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bdb9f60c-185c-499a-a816-93899bb383ee tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-quobyte-cf98b4af-1746-4cdc-aad5-de9a328b9cdb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-bdb9f60c-185c-499a-a816-93899bb383ee tempest-CreateVolumesFromSnapshotTest-969137350 None] Deleting offline snapshot cf98b4af-1746-4cdc-aad5-de9a328b9cdb of volume 8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-bdb9f60c-185c-499a-a816-93899bb383ee tempest-CreateVolumesFromSnapshotTest-969137350 None] snapshot_file for this snap is: volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.cf98b4af-1746-4cdc-aad5-de9a328b9cdb {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a2f1d5-56c1-4d89-b031-3b9055fe5fb8]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bdb9f60c-185c-499a-a816-93899bb383ee tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.cf98b4af-1746-4cdc-aad5-de9a328b9cdb {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:29 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97 1073741824" returned: 0 in 0.525s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:29 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.cf98b4af-1746-4cdc-aad5-de9a328b9cdb Jul 14 13:15:29 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:29 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c5103936-aa27-4f60-8b81-e0b8ff3ab315 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.366s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-c5103936-aa27-4f60-8b81-e0b8ff3ab315 tempest-CreateVolumesFromSnapshotTest-969137350 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:29 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c5103936-aa27-4f60-8b81-e0b8ff3ab315 tempest-CreateVolumesFromSnapshotTest-969137350 None] Deleted volume successfully. Jul 14 13:15:29 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97 Jul 14 13:15:29 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c5103936-aa27-4f60-8b81-e0b8ff3ab315 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-e6a332e4-a1ee-4c98-8c1f-3250439db420-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:29 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bdb9f60c-185c-499a-a816-93899bb383ee tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.cf98b4af-1746-4cdc-aad5-de9a328b9cdb" returned: 0 in 0.402s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-bdb9f60c-185c-499a-a816-93899bb383ee tempest-CreateVolumesFromSnapshotTest-969137350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d13c00-6a58-4c65-8703-f9859eddc54f]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bdb9f60c-185c-499a-a816-93899bb383ee tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:29 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97" returned: 0 in 0.304s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66ecc527-be92-46d1-81ba-eb46705db688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-891c8bb2-091a-4f6a-836f-b89120611f97', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c74c074e-4222-429d-be40-c3e9b6cf3d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:29 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Volume volume-891c8bb2-091a-4f6a-836f-b89120611f97 (891c8bb2-091a-4f6a-836f-b89120611f97): created successfully Jul 14 13:15:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c74c074e-4222-429d-be40-c3e9b6cf3d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:30 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Flow 'volume_create_manager' (eb95a0e6-4e3c-4b35-b79f-ffcf3f5a7c5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:30 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-a1ee28c9-9c78-4e34-a42e-f735269313ec tempest-VolumeDependencyTests-168015083 None] Created volume successfully. Jul 14 13:15:30 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b Jul 14 13:15:30 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:30 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bdb9f60c-185c-499a-a816-93899bb383ee tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b" returned: 0 in 0.406s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bdb9f60c-185c-499a-a816-93899bb383ee tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.cf98b4af-1746-4cdc-aad5-de9a328b9cdb {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:30 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.cf98b4af-1746-4cdc-aad5-de9a328b9cdb Jul 14 13:15:30 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4067f06a-0d55-4430-8d8b-08e5887a24ac tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4067f06a-0d55-4430-8d8b-08e5887a24ac tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-4067f06a-0d55-4430-8d8b-08e5887a24ac tempest-ProjectMemberTests-1712779975 None] Creating offline snapshot bec49d06-7f94-44da-b490-009bbac70873 of volume a2569a11-01a2-4ee9-95eb-bcdf47b37a81 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:15:30 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5ca002-635d-463b-94da-7453becc5d17]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4067f06a-0d55-4430-8d8b-08e5887a24ac tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:30 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81 Jul 14 13:15:30 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:30 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bdb9f60c-185c-499a-a816-93899bb383ee tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.cf98b4af-1746-4cdc-aad5-de9a328b9cdb" returned: 0 in 0.482s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bdb9f60c-185c-499a-a816-93899bb383ee tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.cf98b4af-1746-4cdc-aad5-de9a328b9cdb {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:30 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.cf98b4af-1746-4cdc-aad5-de9a328b9cdb Jul 14 13:15:30 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-72bcb094-59e8-45b8-88ba-3c5d8d260138 tempest-VolumeDependencyTests-168015083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:30 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4067f06a-0d55-4430-8d8b-08e5887a24ac tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81" returned: 0 in 0.428s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4067f06a-0d55-4430-8d8b-08e5887a24ac tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.bec49d06-7f94-44da-b490-009bbac70873 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:30 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.bec49d06-7f94-44da-b490-009bbac70873 1G Jul 14 13:15:30 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:31 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-bdb9f60c-185c-499a-a816-93899bb383ee tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b.cf98b4af-1746-4cdc-aad5-de9a328b9cdb" returned: 0 in 0.296s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bdb9f60c-185c-499a-a816-93899bb383ee tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-quobyte-cf98b4af-1746-4cdc-aad5-de9a328b9cdb" released by "_delete_snapshot" :: held 1.728s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bdb9f60c-185c-499a-a816-93899bb383ee tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-quobyte-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b" released by "delete_snapshot" :: held 1.757s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-bdb9f60c-185c-499a-a816-93899bb383ee tempest-CreateVolumesFromSnapshotTest-969137350 None] Created reservations ['7f7ca8d8-0e44-441e-8c4b-6158d81ae09c', '4df6996b-ad0a-410e-81b6-ec48a8638fdf', 'eb3147bd-c84d-4565-9458-f8379c549f94', 'd350dff1-8a14-4dd2-a2b8-b9b4e447a5bd'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:31 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-bdb9f60c-185c-499a-a816-93899bb383ee tempest-CreateVolumesFromSnapshotTest-969137350 None] Delete snapshot completed successfully. Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-bdb9f60c-185c-499a-a816-93899bb383ee tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-cf98b4af-1746-4cdc-aad5-de9a328b9cdb-delete_snapshot" released by "delete_snapshot" :: held 1.916s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:31 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4067f06a-0d55-4430-8d8b-08e5887a24ac tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.bec49d06-7f94-44da-b490-009bbac70873 1G" returned: 0 in 0.477s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4067f06a-0d55-4430-8d8b-08e5887a24ac tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.bec49d06-7f94-44da-b490-009bbac70873 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:31 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.bec49d06-7f94-44da-b490-009bbac70873 Jul 14 13:15:31 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fd95858e-ecb4-4090-8270-4b9bcd9228e9 tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "cinder-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fd95858e-ecb4-4090-8270-4b9bcd9228e9 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fd95858e-ecb4-4090-8270-4b9bcd9228e9 tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "cinder-quobyte-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fd95858e-ecb4-4090-8270-4b9bcd9228e9 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-quobyte-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b" acquired by "delete_volume" :: waited 0.028s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0091a4-af9c-4091-8c6b-0c19bc4894d1]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fd95858e-ecb4-4090-8270-4b9bcd9228e9 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:31 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4067f06a-0d55-4430-8d8b-08e5887a24ac tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.bec49d06-7f94-44da-b490-009bbac70873" returned: 0 in 0.335s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:31 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-4067f06a-0d55-4430-8d8b-08e5887a24ac tempest-ProjectMemberTests-1712779975 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.bec49d06-7f94-44da-b490-009bbac70873 is being set with open permissions: ugo+rw Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4067f06a-0d55-4430-8d8b-08e5887a24ac tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.bec49d06-7f94-44da-b490-009bbac70873 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:31 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.bec49d06-7f94-44da-b490-009bbac70873 Jul 14 13:15:31 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:31 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b Jul 14 13:15:31 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Flow 'volume_create_manager' (37f2635b-1fba-47e9-9403-ed6a04bb16bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474233ec-6f8b-4224-8c74-a7bc91bae683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474233ec-6f8b-4224-8c74-a7bc91bae683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b459eb72-abce-41e4-ba76-cbd7b1b50ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58a8c32f7b04cd481b8e227365877fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:32Z,use_quota=True,user_id='c207aa9266ab48ab84e821424f51b094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95fe70d9-f08d-4e83-804f-f200b431b732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95fe70d9-f08d-4e83-804f-f200b431b732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79f7ce9-354c-43e4-9925-bfd76ab756ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:31 devstack cinder-volume[86977]: DEBUG cinder.image.glance [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Creating Keystone auth plugin from conf {{(pid=86977) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 13:15:32 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4067f06a-0d55-4430-8d8b-08e5887a24ac tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.bec49d06-7f94-44da-b490-009bbac70873" returned: 0 in 0.292s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:32 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4067f06a-0d55-4430-8d8b-08e5887a24ac tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fd95858e-ecb4-4090-8270-4b9bcd9228e9 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b" returned: 0 in 0.411s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fd95858e-ecb4-4090-8270-4b9bcd9228e9 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:32 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.info Jul 14 13:15:32 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79f7ce9-354c-43e4-9925-bfd76ab756ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b459eb72-abce-41e4-ba76-cbd7b1b50ca8', 'volume_name': 'volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8', 'volume_size': 1, 'image_id': '042b1917-77eb-4ee8-99de-689feb32c3ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/042b1917-77eb-4ee8-99de-689feb32c3ca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be1f85718e58ada5b4b91b582c3ddc06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f58a8c32f7b04cd481b8e227365877fa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e304aece1969de2e0e5ea0aca0c267554387db8777d320d645568902f0ec3f2427e8716df6c6226b82d0aaa13b042d72c8f3bec65406e6d5be87ed63fea48779', 'id': '042b1917-77eb-4ee8-99de-689feb32c3ca', 'created_at': datetime.datetime(2026, 7, 14, 11, 15, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 11, 15, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/042b1917-77eb-4ee8-99de-689feb32c3ca/file', 'properties': {}}, 'image_service': }' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:32 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (474a7e7b-7e35-4f59-954d-6ff54a416bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:32 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (474a7e7b-7e35-4f59-954d-6ff54a416bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0e5f47-92a4-4b21-905b-798998684e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:32 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Volume b459eb72-abce-41e4-ba76-cbd7b1b50ca8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8', 'volume_size': 1, 'image_id': '042b1917-77eb-4ee8-99de-689feb32c3ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/042b1917-77eb-4ee8-99de-689feb32c3ca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be1f85718e58ada5b4b91b582c3ddc06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f58a8c32f7b04cd481b8e227365877fa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e304aece1969de2e0e5ea0aca0c267554387db8777d320d645568902f0ec3f2427e8716df6c6226b82d0aaa13b042d72c8f3bec65406e6d5be87ed63fea48779', 'id': '042b1917-77eb-4ee8-99de-689feb32c3ca', 'created_at': datetime.datetime(2026, 7, 14, 11, 15, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 11, 15, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/042b1917-77eb-4ee8-99de-689feb32c3ca/file', 'properties': {}}, 'image_service': } Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Trying to clone b459eb72-abce-41e4-ba76-cbd7b1b50ca8 from image 042b1917-77eb-4ee8-99de-689feb32c3ca at location (None, [{'url': 'file:///opt/stack/data/glance/images/042b1917-77eb-4ee8-99de-689feb32c3ca', 'metadata': {}}]). {{(pid=86977) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:751}} Jul 14 13:15:32 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Image download 0.00 MB at 0.00 MB/s Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f75089-debc-4bd5-8bb6-5b0e36ca61dc]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:32 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4067f06a-0d55-4430-8d8b-08e5887a24ac tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.info" returned: 0 in 0.313s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:32 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-4067f06a-0d55-4430-8d8b-08e5887a24ac tempest-ProjectMemberTests-1712779975 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.info is being set with open permissions: ugo+rw Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4067f06a-0d55-4430-8d8b-08e5887a24ac tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:32 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fd95858e-ecb4-4090-8270-4b9bcd9228e9 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b" returned: 0 in 0.307s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:32 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.info Jul 14 13:15:32 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fd95858e-ecb4-4090-8270-4b9bcd9228e9 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-quobyte-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b" released by "delete_volume" :: held 0.783s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:32 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD Jul 14 13:15:32 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-fd95858e-ecb4-4090-8270-4b9bcd9228e9 tempest-CreateVolumesFromSnapshotTest-969137350 None] Created reservations ['06541b06-4730-422b-999e-a5a8ee2b8f6f', 'ad03664b-5d42-43ff-a2f0-776c232ae7a1', 'f3fc131c-d254-4819-ad03-078d3a8991e3', 'd0de868a-1c08-47d7-bfe6-89791bbc6107'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fd95858e-ecb4-4090-8270-4b9bcd9228e9 tempest-CreateVolumesFromSnapshotTest-969137350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fd95858e-ecb4-4090-8270-4b9bcd9228e9 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fd95858e-ecb4-4090-8270-4b9bcd9228e9 tempest-CreateVolumesFromSnapshotTest-969137350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fd95858e-ecb4-4090-8270-4b9bcd9228e9 tempest-CreateVolumesFromSnapshotTest-969137350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fd95858e-ecb4-4090-8270-4b9bcd9228e9 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fd95858e-ecb4-4090-8270-4b9bcd9228e9 tempest-CreateVolumesFromSnapshotTest-969137350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:32 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:32 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:32 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4067f06a-0d55-4430-8d8b-08e5887a24ac tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.info" returned: 0 in 0.304s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4067f06a-0d55-4430-8d8b-08e5887a24ac tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.252s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-72bcb094-59e8-45b8-88ba-3c5d8d260138 tempest-VolumeDependencyTests-168015083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.862s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-72bcb094-59e8-45b8-88ba-3c5d8d260138 tempest-VolumeDependencyTests-168015083 None] Creating offline snapshot 75eb273d-8890-4258-aa5e-74fb8c658206 of volume 891c8bb2-091a-4f6a-836f-b89120611f97 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:15:32 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b462d6-d64f-4ad5-bba0-ad6021436786]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-72bcb094-59e8-45b8-88ba-3c5d8d260138 tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:32 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-4067f06a-0d55-4430-8d8b-08e5887a24ac tempest-ProjectMemberTests-1712779975 None] Create snapshot completed successfully Jul 14 13:15:32 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fd95858e-ecb4-4090-8270-4b9bcd9228e9 tempest-CreateVolumesFromSnapshotTest-969137350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.287s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-fd95858e-ecb4-4090-8270-4b9bcd9228e9 tempest-CreateVolumesFromSnapshotTest-969137350 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:32 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-fd95858e-ecb4-4090-8270-4b9bcd9228e9 tempest-CreateVolumesFromSnapshotTest-969137350 None] Deleted volume successfully. Jul 14 13:15:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fd95858e-ecb4-4090-8270-4b9bcd9228e9 tempest-CreateVolumesFromSnapshotTest-969137350 None] Lock "cinder-8b36e6e1-6ba9-40b0-bd4e-4a90fcccc37b-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:32 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD Jul 14 13:15:32 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:32 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97 Jul 14 13:15:32 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:33 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD" returned: 1 in 0.418s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:15:33 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Temporary image 042b1917-77eb-4ee8-99de-689feb32c3ca is fetched for user c207aa9266ab48ab84e821424f51b094. {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:1450}} Jul 14 13:15:33 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-72bcb094-59e8-45b8-88ba-3c5d8d260138 tempest-VolumeDependencyTests-168015083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97" returned: 0 in 0.437s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-72bcb094-59e8-45b8-88ba-3c5d8d260138 tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:33 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206 1G Jul 14 13:15:33 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:33 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[3403cd99-dcae-4dd9-9d80-69b17eb10b56]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:33 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD Jul 14 13:15:33 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:33 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:33 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5201a0a1-3401-4ac9-be02-9867dd942fde tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-bec49d06-7f94-44da-b490-009bbac70873-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-72bcb094-59e8-45b8-88ba-3c5d8d260138 tempest-VolumeDependencyTests-168015083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206 1G" returned: 0 in 0.532s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-72bcb094-59e8-45b8-88ba-3c5d8d260138 tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-891c8bb2-091a-4f6a-836f-b89120611f97 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5201a0a1-3401-4ac9-be02-9867dd942fde tempest-ProjectMemberTests-1712779975 None] Lock "cinder-bec49d06-7f94-44da-b490-009bbac70873-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5201a0a1-3401-4ac9-be02-9867dd942fde tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-a2569a11-01a2-4ee9-95eb-bcdf47b37a81" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:33 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-891c8bb2-091a-4f6a-836f-b89120611f97 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206 Jul 14 13:15:33 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5201a0a1-3401-4ac9-be02-9867dd942fde tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-a2569a11-01a2-4ee9-95eb-bcdf47b37a81" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5201a0a1-3401-4ac9-be02-9867dd942fde tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-bec49d06-7f94-44da-b490-009bbac70873" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:33 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5201a0a1-3401-4ac9-be02-9867dd942fde tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-bec49d06-7f94-44da-b490-009bbac70873" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-5201a0a1-3401-4ac9-be02-9867dd942fde tempest-ProjectMemberTests-1712779975 None] Deleting offline snapshot bec49d06-7f94-44da-b490-009bbac70873 of volume a2569a11-01a2-4ee9-95eb-bcdf47b37a81 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:15:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-5201a0a1-3401-4ac9-be02-9867dd942fde tempest-ProjectMemberTests-1712779975 None] snapshot_file for this snap is: volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.bec49d06-7f94-44da-b490-009bbac70873 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:15:33 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD Jul 14 13:15:33 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:33 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6f0272-d610-4d0f-b327-d288c1629996]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5201a0a1-3401-4ac9-be02-9867dd942fde tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.bec49d06-7f94-44da-b490-009bbac70873 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:34 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.bec49d06-7f94-44da-b490-009bbac70873 Jul 14 13:15:34 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:34 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-72bcb094-59e8-45b8-88ba-3c5d8d260138 tempest-VolumeDependencyTests-168015083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-891c8bb2-091a-4f6a-836f-b89120611f97 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206" returned: 0 in 0.374s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:34 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-72bcb094-59e8-45b8-88ba-3c5d8d260138 tempest-VolumeDependencyTests-168015083 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206 is being set with open permissions: ugo+rw Jul 14 13:15:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-72bcb094-59e8-45b8-88ba-3c5d8d260138 tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:34 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD" returned: 1 in 0.490s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:15:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:34 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206 Jul 14 13:15:34 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:34 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5201a0a1-3401-4ac9-be02-9867dd942fde tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.bec49d06-7f94-44da-b490-009bbac70873" returned: 0 in 0.475s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-5201a0a1-3401-4ac9-be02-9867dd942fde tempest-ProjectMemberTests-1712779975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:15:34 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-72bcb094-59e8-45b8-88ba-3c5d8d260138 tempest-VolumeDependencyTests-168015083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206" returned: 0 in 0.278s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:34 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[c668d0ee-2906-4cca-b76d-5a892d210b7c]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5201a0a1-3401-4ac9-be02-9867dd942fde tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-72bcb094-59e8-45b8-88ba-3c5d8d260138 tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:34 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.info Jul 14 13:15:34 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:34 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81 Jul 14 13:15:34 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:34 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-72bcb094-59e8-45b8-88ba-3c5d8d260138 tempest-VolumeDependencyTests-168015083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.info" returned: 0 in 0.276s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:34 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-72bcb094-59e8-45b8-88ba-3c5d8d260138 tempest-VolumeDependencyTests-168015083 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.info is being set with open permissions: ugo+rw Jul 14 13:15:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-72bcb094-59e8-45b8-88ba-3c5d8d260138 tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:34 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.info Jul 14 13:15:34 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:34 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5201a0a1-3401-4ac9-be02-9867dd942fde tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81" returned: 0 in 0.390s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5201a0a1-3401-4ac9-be02-9867dd942fde tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.bec49d06-7f94-44da-b490-009bbac70873 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:34 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.bec49d06-7f94-44da-b490-009bbac70873 Jul 14 13:15:34 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:35 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-72bcb094-59e8-45b8-88ba-3c5d8d260138 tempest-VolumeDependencyTests-168015083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.info" returned: 0 in 0.281s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-72bcb094-59e8-45b8-88ba-3c5d8d260138 tempest-VolumeDependencyTests-168015083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.319s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.883s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b459eb72-abce-41e4-ba76-cbd7b1b50ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58a8c32f7b04cd481b8e227365877fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:32Z,use_quota=True,user_id='c207aa9266ab48ab84e821424f51b094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Creating volume b459eb72-abce-41e4-ba76-cbd7b1b50ca8 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:35 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:35 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8 1073741824 Jul 14 13:15:35 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:35 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-72bcb094-59e8-45b8-88ba-3c5d8d260138 tempest-VolumeDependencyTests-168015083 None] Create snapshot completed successfully Jul 14 13:15:35 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5201a0a1-3401-4ac9-be02-9867dd942fde tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.bec49d06-7f94-44da-b490-009bbac70873" returned: 0 in 0.373s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5201a0a1-3401-4ac9-be02-9867dd942fde tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.bec49d06-7f94-44da-b490-009bbac70873 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:35 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.bec49d06-7f94-44da-b490-009bbac70873 Jul 14 13:15:35 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:35 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5201a0a1-3401-4ac9-be02-9867dd942fde tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81.bec49d06-7f94-44da-b490-009bbac70873" returned: 0 in 0.278s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5201a0a1-3401-4ac9-be02-9867dd942fde tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-bec49d06-7f94-44da-b490-009bbac70873" released by "_delete_snapshot" :: held 1.657s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:35 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5201a0a1-3401-4ac9-be02-9867dd942fde tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-a2569a11-01a2-4ee9-95eb-bcdf47b37a81" released by "delete_snapshot" :: held 1.699s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8 1073741824" returned: 0 in 0.479s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:35 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8 Jul 14 13:15:35 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-5201a0a1-3401-4ac9-be02-9867dd942fde tempest-ProjectMemberTests-1712779975 None] Created reservations ['a3ba4bf8-dcf4-452b-8a02-e80786e88f81', '80506b67-3257-45f2-ae84-a49da515ea32', '9625e839-56b4-43c5-a6d8-99e71d0d8c44', '24e6fed0-0a93-42ef-b4c3-735146ecf52b'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:35 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-5201a0a1-3401-4ac9-be02-9867dd942fde tempest-ProjectMemberTests-1712779975 None] Delete snapshot completed successfully. Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5201a0a1-3401-4ac9-be02-9867dd942fde tempest-ProjectMemberTests-1712779975 None] Lock "cinder-bec49d06-7f94-44da-b490-009bbac70873-delete_snapshot" released by "delete_snapshot" :: held 1.892s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:35 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8" returned: 0 in 0.257s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Attempting download of 042b1917-77eb-4ee8-99de-689feb32c3ca ((None, [{'url': 'file:///opt/stack/data/glance/images/042b1917-77eb-4ee8-99de-689feb32c3ca', 'metadata': {}}])) to volume b459eb72-abce-41e4-ba76-cbd7b1b50ca8. {{(pid=86977) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b206f3f-ac63-47af-b791-f5f6e39f12c4]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_042b1917-77eb-4ee8-99de-689feb32c3ca_ud6c62v2 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fc9c69d7-9748-453c-9723-59055158fbea tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-a2569a11-01a2-4ee9-95eb-bcdf47b37a81-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fc9c69d7-9748-453c-9723-59055158fbea tempest-ProjectMemberTests-1712779975 None] Lock "cinder-a2569a11-01a2-4ee9-95eb-bcdf47b37a81-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:36 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_042b1917-77eb-4ee8-99de-689feb32c3ca_ud6c62v2 Jul 14 13:15:36 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fc9c69d7-9748-453c-9723-59055158fbea tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-a2569a11-01a2-4ee9-95eb-bcdf47b37a81" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fc9c69d7-9748-453c-9723-59055158fbea tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-a2569a11-01a2-4ee9-95eb-bcdf47b37a81" acquired by "delete_volume" :: waited 0.027s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:36 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bfaef5-4570-456e-9a77-2d299d5fc2df]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc9c69d7-9748-453c-9723-59055158fbea tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:36 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_042b1917-77eb-4ee8-99de-689feb32c3ca_ud6c62v2" returned: 0 in 0.365s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_042b1917-77eb-4ee8-99de-689feb32c3ca_ud6c62v2 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:36 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81 Jul 14 13:15:36 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:36 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_042b1917-77eb-4ee8-99de-689feb32c3ca_ud6c62v2 Jul 14 13:15:36 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:36 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc9c69d7-9748-453c-9723-59055158fbea tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81" returned: 0 in 0.550s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc9c69d7-9748-453c-9723-59055158fbea tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:36 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_042b1917-77eb-4ee8-99de-689feb32c3ca_ud6c62v2" returned: 1 in 0.435s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_042b1917-77eb-4ee8-99de-689feb32c3ca_ud6c62v2' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:15:36 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b809261-3445-4b20-b321-1bd3a509b478]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:36 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81 Jul 14 13:15:36 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:36 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD Jul 14 13:15:36 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:36 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Flow 'volume_create_manager' (49dabde2-6c59-4d87-aec4-3859107f1e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4bfd404-d452-45cd-b939-5eeda93ef9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:36 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4bfd404-d452-45cd-b939-5eeda93ef9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1978857894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6f3966d-f4d6-43a4-b2fd-8e188c75cf06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19db12207814faab3331e1ae1fbcdca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:37Z,use_quota=True,user_id='e4d8cf14566c4c4eb638a53175c20e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:36 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ed74a6-82b6-49a5-884e-f7cf2754fbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ed74a6-82b6-49a5-884e-f7cf2754fbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0041c16-7783-49c6-929b-f99053aad895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0041c16-7783-49c6-929b-f99053aad895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6f3966d-f4d6-43a4-b2fd-8e188c75cf06', 'volume_name': 'volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88899f7-72c6-4a3f-8a6d-666e1633dca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88899f7-72c6-4a3f-8a6d-666e1633dca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c623e2d5-4d7f-4a54-907d-0f8ace511d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:37 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Volume f6f3966d-f4d6-43a4-b2fd-8e188c75cf06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06', 'volume_size': 1} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1978857894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6f3966d-f4d6-43a4-b2fd-8e188c75cf06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19db12207814faab3331e1ae1fbcdca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:37Z,use_quota=True,user_id='e4d8cf14566c4c4eb638a53175c20e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Creating volume f6f3966d-f4d6-43a4-b2fd-8e188c75cf06 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:37 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc9c69d7-9748-453c-9723-59055158fbea tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a2569a11-01a2-4ee9-95eb-bcdf47b37a81" returned: 0 in 0.320s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:37 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06 1073741824 Jul 14 13:15:37 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fc9c69d7-9748-453c-9723-59055158fbea tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-a2569a11-01a2-4ee9-95eb-bcdf47b37a81" released by "delete_volume" :: held 0.960s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:37 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Flow 'volume_create_manager' (0bb22a9d-82e6-4e44-b8b6-643b89476ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084b57f2-f081-497e-b5d0-7749c9de6e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084b57f2-f081-497e-b5d0-7749c9de6e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-844880915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e53afb8-1b93-4a02-b76b-448e0b2a7e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7a59e8fae740889138f23ecc2c9925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=75eb273d-8890-4258-aa5e-74fb8c658206,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:37Z,use_quota=True,user_id='e1cf14ad749c4053a046915faab35e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d924b26-5ce6-4316-b464-5ac74e158de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d924b26-5ce6-4316-b464-5ac74e158de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b188c75-1924-4915-87b9-01792e97c2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b188c75-1924-4915-87b9-01792e97c2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7e53afb8-1b93-4a02-b76b-448e0b2a7e73', 'volume_name': 'volume-7e53afb8-1b93-4a02-b76b-448e0b2a7e73', 'volume_size': 1, 'snapshot_id': '75eb273d-8890-4258-aa5e-74fb8c658206'}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b018c8b5-525b-4f73-a5ff-cf0836908286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b018c8b5-525b-4f73-a5ff-cf0836908286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a31c9c-6bc9-4226-a2de-395619f74983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:37 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Volume 7e53afb8-1b93-4a02-b76b-448e0b2a7e73: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7e53afb8-1b93-4a02-b76b-448e0b2a7e73', 'volume_size': 1, 'snapshot_id': '75eb273d-8890-4258-aa5e-74fb8c658206'} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-fc9c69d7-9748-453c-9723-59055158fbea tempest-ProjectMemberTests-1712779975 None] Created reservations ['fec20bac-3db6-4519-8ee9-8431bf868aef', 'ef1e6c4f-f4a6-43ae-8384-de5d99f08df9', '52328058-2e6b-4b44-8760-73370c963001', '8361767b-90ce-4445-b098-323cdd63189f'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:37 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD Jul 14 13:15:37 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc9c69d7-9748-453c-9723-59055158fbea tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc9c69d7-9748-453c-9723-59055158fbea tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fc9c69d7-9748-453c-9723-59055158fbea tempest-ProjectMemberTests-1712779975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fc9c69d7-9748-453c-9723-59055158fbea tempest-ProjectMemberTests-1712779975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc9c69d7-9748-453c-9723-59055158fbea tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc9c69d7-9748-453c-9723-59055158fbea tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:37 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:37 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:37 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06 1073741824" returned: 0 in 0.469s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:37 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD" returned: 1 in 0.379s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] 042b1917-77eb-4ee8-99de-689feb32c3ca was raw, converting to raw {{(pid=86977) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1139}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:37 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8 Jul 14 13:15:37 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:37 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc9c69d7-9748-453c-9723-59055158fbea tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.264s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-fc9c69d7-9748-453c-9723-59055158fbea tempest-ProjectMemberTests-1712779975 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:37 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06 Jul 14 13:15:37 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:37 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-fc9c69d7-9748-453c-9723-59055158fbea tempest-ProjectMemberTests-1712779975 None] Deleted volume successfully. Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-fc9c69d7-9748-453c-9723-59055158fbea tempest-ProjectMemberTests-1712779975 None] Lock "cinder-a2569a11-01a2-4ee9-95eb-bcdf47b37a81-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:37 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06" returned: 0 in 0.280s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.638s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Acquiring lock "cinder-quobyte-75eb273d-8890-4258-aa5e-74fb8c658206-7e53afb8-1b93-4a02-b76b-448e0b2a7e73" by "_create_volume_from_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c623e2d5-4d7f-4a54-907d-0f8ace511d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9fb1db3-b104-45c0-a926-f16cb4a6ddd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Lock "cinder-quobyte-75eb273d-8890-4258-aa5e-74fb8c658206-7e53afb8-1b93-4a02-b76b-448e0b2a7e73" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:37 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Creating volume 7e53afb8-1b93-4a02-b76b-448e0b2a7e73 from snapshot 75eb273d-8890-4258-aa5e-74fb8c658206 {{(pid=86977) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Acquiring lock "cinder-quobyte-7e53afb8-1b93-4a02-b76b-448e0b2a7e73" by "_copy_volume_from_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8" returned: 0 in 0.372s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_042b1917-77eb-4ee8-99de-689feb32c3ca_br6i8zwndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8 {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:15:37 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Converted 0.00 MB image at 0.00 MB/s Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:37 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Volume volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06 (f6f3966d-f4d6-43a4-b2fd-8e188c75cf06): created successfully Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9fb1db3-b104-45c0-a926-f16cb4a6ddd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Flow 'volume_create_manager' (49dabde2-6c59-4d87-aec4-3859107f1e70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:37 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8 1G Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Lock "cinder-quobyte-7e53afb8-1b93-4a02-b76b-448e0b2a7e73" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] snapshot: 75eb273d-8890-4258-aa5e-74fb8c658206, volume: 7e53afb8-1b93-4a02-b76b-448e0b2a7e73, {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 13:15:37 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:37 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-3a8f854a-0509-4abf-ae29-b797c6c59b00 tempest-ProjectReaderTests-992783010 None] Created volume successfully. Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9ff370-06b0-4519-9f10-9a53bec59f16]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:38 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206 Jul 14 13:15:38 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:38 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8 1G" returned: 0 in 0.302s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc22d0b5-f0bc-4084-9211-ff95f56211f3]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:38 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206" returned: 0 in 0.388s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-891c8bb2-091a-4f6a-836f-b89120611f97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97 {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Creating direct copy from snapshot {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 13:15:38 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8 Jul 14 13:15:38 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c8c6ca-2b80-4495-9a39-584bdaa562d4]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:38 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97 Jul 14 13:15:38 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:38 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8" returned: 0 in 0.379s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:38 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8 Jul 14 13:15:38 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:38 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Flow 'volume_create_manager' (849534c9-1861-4867-8731-effdd9aebf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9238a3bc-f595-4cbe-bc15-6b01da87a16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97" returned: 0 in 0.524s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG cinder.utils [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Path /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7e53afb8-1b93-4a02-b76b-448e0b2a7e73 not found in is_blk_device check {{(pid=86977) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7e53afb8-1b93-4a02-b76b-448e0b2a7e73 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9238a3bc-f595-4cbe-bc15-6b01da87a16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1216108779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de544c1-4013-4396-b7a3-0d66e3e826ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ce77d922d74f64be5aceab89b43e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:39Z,use_quota=True,user_id='a8d39912638c4ab594816189250d21e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31732267-1bbe-43d0-9937-ff15592c0b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:38 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7e53afb8-1b93-4a02-b76b-448e0b2a7e73 Jul 14 13:15:38 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31732267-1bbe-43d0-9937-ff15592c0b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96908c4-4553-4862-b5be-819e097daa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96908c4-4553-4862-b5be-819e097daa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6de544c1-4013-4396-b7a3-0d66e3e826ba', 'volume_name': 'volume-6de544c1-4013-4396-b7a3-0d66e3e826ba', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:38 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5324d428-9bf0-43eb-8aec-1748e84ee993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5324d428-9bf0-43eb-8aec-1748e84ee993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7080d503-1e32-4cbf-89f4-547ea903cb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:39 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Volume 6de544c1-4013-4396-b7a3-0d66e3e826ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6de544c1-4013-4396-b7a3-0d66e3e826ba', 'volume_size': 1} Jul 14 13:15:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5595a78a-8b4b-420c-a1a7-c0bf85f10d51 tempest-ProjectReaderTests-992783010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:39 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8" returned: 1 in 0.509s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:15:39 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Downloaded image 042b1917-77eb-4ee8-99de-689feb32c3ca ((None, [{'url': 'file:///opt/stack/data/glance/images/042b1917-77eb-4ee8-99de-689feb32c3ca', 'metadata': {}}])) to volume b459eb72-abce-41e4-ba76-cbd7b1b50ca8 successfully. {{(pid=86977) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 13:15:39 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Temporary image 042b1917-77eb-4ee8-99de-689feb32c3ca for user c207aa9266ab48ab84e821424f51b094 is deleted. {{(pid=86977) fetch /opt/stack/cinder/cinder/image/image_utils.py:1454}} Jul 14 13:15:39 devstack cinder-volume[86977]: DEBUG cinder.volume.volume_utils [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Marking volume b459eb72-abce-41e4-ba76-cbd7b1b50ca8 as bootable. {{(pid=86977) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 13:15:39 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Copying metadata from image 042b1917-77eb-4ee8-99de-689feb32c3ca to b459eb72-abce-41e4-ba76-cbd7b1b50ca8. {{(pid=86977) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 13:15:39 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Creating volume glance metadata for volume b459eb72-abce-41e4-ba76-cbd7b1b50ca8 backed by image 042b1917-77eb-4ee8-99de-689feb32c3ca with: {'image_id': '042b1917-77eb-4ee8-99de-689feb32c3ca', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'be1f85718e58ada5b4b91b582c3ddc06', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86977) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 13:15:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0e5f47-92a4-4b21-905b-798998684e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8', 'volume_size': 1, 'image_id': '042b1917-77eb-4ee8-99de-689feb32c3ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/042b1917-77eb-4ee8-99de-689feb32c3ca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be1f85718e58ada5b4b91b582c3ddc06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f58a8c32f7b04cd481b8e227365877fa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e304aece1969de2e0e5ea0aca0c267554387db8777d320d645568902f0ec3f2427e8716df6c6226b82d0aaa13b042d72c8f3bec65406e6d5be87ed63fea48779', 'id': '042b1917-77eb-4ee8-99de-689feb32c3ca', 'created_at': datetime.datetime(2026, 7, 14, 11, 15, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 11, 15, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/042b1917-77eb-4ee8-99de-689feb32c3ca/file', 'properties': {}}, 'image_service': }' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f2603a-2f4d-41c5-83ef-58ceb370d32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:39 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Volume volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8 (b459eb72-abce-41e4-ba76-cbd7b1b50ca8): created successfully Jul 14 13:15:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f2603a-2f4d-41c5-83ef-58ceb370d32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:39 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Flow 'volume_create_manager' (37f2635b-1fba-47e9-9403-ed6a04bb16bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:39 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-71b08dac-57cf-4f34-967a-d89101d09ff8 tempest-VolumeImageDependencyTests-2067993094 None] Created volume successfully. Jul 14 13:15:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] Acquiring lock "cinder-b459eb72-abce-41e4-ba76-cbd7b1b50ca8-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] Lock "cinder-b459eb72-abce-41e4-ba76-cbd7b1b50ca8-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] Acquiring lock "cinder-quobyte-b459eb72-abce-41e4-ba76-cbd7b1b50ca8" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] Lock "cinder-quobyte-b459eb72-abce-41e4-ba76-cbd7b1b50ca8" acquired by "delete_volume" :: waited 0.042s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:39 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[157593b7-9405-4132-92fe-0871f04745d5]: (4, 'raw') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:40 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8 Jul 14 13:15:40 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:40 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8" returned: 0 in 0.596s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:40 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8 Jul 14 13:15:40 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:41 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8" returned: 1 in 0.742s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8' failed. Not Retrying. {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 13:15:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:41 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8 Jul 14 13:15:41 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:41 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-b459eb72-abce-41e4-ba76-cbd7b1b50ca8" returned: 0 in 0.516s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:41 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] Lock "cinder-quobyte-b459eb72-abce-41e4-ba76-cbd7b1b50ca8" released by "delete_volume" :: held 2.019s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:41 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] Created reservations ['e08a427d-e2fc-4821-a356-18db6de346ab', 'caf653e0-2524-4d99-9620-a94af05bf94e', 'b5aaa3e4-3b90-4162-9f5a-705a368a709e', 'eee98ce7-f240-4e64-95eb-211191982ed3'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:42 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:42 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:42 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:42 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:42 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.890s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:42 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:42 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] Deleted volume successfully. Jul 14 13:15:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c15e868a-384d-4eba-a343-d0bbfa4ea080 tempest-VolumeImageDependencyTests-2067993094 None] Lock "cinder-b459eb72-abce-41e4-ba76-cbd7b1b50ca8-delete_volume" released by "delete_volume" :: held 3.430s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:43 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7e53afb8-1b93-4a02-b76b-448e0b2a7e73" returned: 0 in 4.909s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:43 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd9440e-6e52-4e8f-8213-dbfebd7f93eb]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:43 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97 Jul 14 13:15:43 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:44 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97" returned: 0 in 0.552s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:44 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Image conversion details: src /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97, size 1024.00 MB, duration 4.91 sec, destination /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7e53afb8-1b93-4a02-b76b-448e0b2a7e73 {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:15:44 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Converted 1024.00 MB image at 208.54 MB/s Jul 14 13:15:44 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7e53afb8-1b93-4a02-b76b-448e0b2a7e73 is being set with open permissions: ugo+rw Jul 14 13:15:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7e53afb8-1b93-4a02-b76b-448e0b2a7e73 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:44 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7e53afb8-1b93-4a02-b76b-448e0b2a7e73 Jul 14 13:15:44 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:44 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7e53afb8-1b93-4a02-b76b-448e0b2a7e73" returned: 0 in 0.272s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:44 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Lock "cinder-quobyte-7e53afb8-1b93-4a02-b76b-448e0b2a7e73" released by "_copy_volume_from_snapshot" :: held 6.748s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:44 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Lock "cinder-quobyte-75eb273d-8890-4258-aa5e-74fb8c658206-7e53afb8-1b93-4a02-b76b-448e0b2a7e73" released by "_create_volume_from_snapshot" :: held 6.803s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.834s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.692s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:44 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1216108779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de544c1-4013-4396-b7a3-0d66e3e826ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ce77d922d74f64be5aceab89b43e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:39Z,use_quota=True,user_id='a8d39912638c4ab594816189250d21e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:44 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Creating volume 6de544c1-4013-4396-b7a3-0d66e3e826ba {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:44 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:44 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:44 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:44 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:44 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba 1073741824 Jul 14 13:15:44 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:44 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a31c9c-6bc9-4226-a2de-395619f74983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e53afb8-1b93-4a02-b76b-448e0b2a7e73', 'volume_size': 1, 'snapshot_id': '75eb273d-8890-4258-aa5e-74fb8c658206'}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:44 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10836f15-98a5-4653-9f48-3b9ecd46d8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:44 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Volume volume-7e53afb8-1b93-4a02-b76b-448e0b2a7e73 (7e53afb8-1b93-4a02-b76b-448e0b2a7e73): created successfully Jul 14 13:15:44 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10836f15-98a5-4653-9f48-3b9ecd46d8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:44 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Flow 'volume_create_manager' (0bb22a9d-82e6-4e44-b8b6-643b89476ea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:44 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-a7cfacd2-1181-4cb0-8421-dd84724ec5e1 tempest-VolumeDependencyTests-168015083 None] Created volume successfully. Jul 14 13:15:45 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba 1073741824" returned: 0 in 0.459s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:45 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba Jul 14 13:15:45 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:45 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba" returned: 0 in 0.271s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5595a78a-8b4b-420c-a1a7-c0bf85f10d51 tempest-ProjectReaderTests-992783010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.382s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7080d503-1e32-4cbf-89f4-547ea903cb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6de544c1-4013-4396-b7a3-0d66e3e826ba', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e79e9f9f-8253-4632-83c6-c07e16b3e82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-5595a78a-8b4b-420c-a1a7-c0bf85f10d51 tempest-ProjectReaderTests-992783010 None] Creating offline snapshot 23806120-0485-4bde-8e7c-0c22542d7e8e of volume f6f3966d-f4d6-43a4-b2fd-8e188c75cf06 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:15:45 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Volume volume-6de544c1-4013-4396-b7a3-0d66e3e826ba (6de544c1-4013-4396-b7a3-0d66e3e826ba): created successfully Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e79e9f9f-8253-4632-83c6-c07e16b3e82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Flow 'volume_create_manager' (849534c9-1861-4867-8731-effdd9aebf0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d56dd8-c539-4b11-989d-483fd29cf581]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5595a78a-8b4b-420c-a1a7-c0bf85f10d51 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:45 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-895e8ae7-9021-429d-b657-42735d6415d8 tempest-ProjectMemberTests-1712779975 None] Created volume successfully. Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ca9deb60-9474-4bdd-b2a0-874b84664036 tempest-VolumeDependencyTests-168015083 None] Acquiring lock "cinder-75eb273d-8890-4258-aa5e-74fb8c658206-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ca9deb60-9474-4bdd-b2a0-874b84664036 tempest-VolumeDependencyTests-168015083 None] Lock "cinder-75eb273d-8890-4258-aa5e-74fb8c658206-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ca9deb60-9474-4bdd-b2a0-874b84664036 tempest-VolumeDependencyTests-168015083 None] Acquiring lock "cinder-quobyte-891c8bb2-091a-4f6a-836f-b89120611f97" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ca9deb60-9474-4bdd-b2a0-874b84664036 tempest-VolumeDependencyTests-168015083 None] Lock "cinder-quobyte-891c8bb2-091a-4f6a-836f-b89120611f97" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ca9deb60-9474-4bdd-b2a0-874b84664036 tempest-VolumeDependencyTests-168015083 None] Acquiring lock "cinder-quobyte-75eb273d-8890-4258-aa5e-74fb8c658206" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ca9deb60-9474-4bdd-b2a0-874b84664036 tempest-VolumeDependencyTests-168015083 None] Lock "cinder-quobyte-75eb273d-8890-4258-aa5e-74fb8c658206" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-ca9deb60-9474-4bdd-b2a0-874b84664036 tempest-VolumeDependencyTests-168015083 None] Deleting offline snapshot 75eb273d-8890-4258-aa5e-74fb8c658206 of volume 891c8bb2-091a-4f6a-836f-b89120611f97 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:15:45 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06 Jul 14 13:15:45 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-ca9deb60-9474-4bdd-b2a0-874b84664036 tempest-VolumeDependencyTests-168015083 None] snapshot_file for this snap is: volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c70f3b-7909-4995-bdaa-1a8d4bd648b3]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ca9deb60-9474-4bdd-b2a0-874b84664036 tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:45 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206 Jul 14 13:15:45 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:45 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5595a78a-8b4b-420c-a1a7-c0bf85f10d51 tempest-ProjectReaderTests-992783010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06" returned: 0 in 0.412s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5595a78a-8b4b-420c-a1a7-c0bf85f10d51 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.23806120-0485-4bde-8e7c-0c22542d7e8e 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:45 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.23806120-0485-4bde-8e7c-0c22542d7e8e 1G Jul 14 13:15:45 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:46 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ca9deb60-9474-4bdd-b2a0-874b84664036 tempest-VolumeDependencyTests-168015083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206" returned: 0 in 0.387s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:46 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-ca9deb60-9474-4bdd-b2a0-874b84664036 tempest-VolumeDependencyTests-168015083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-891c8bb2-091a-4f6a-836f-b89120611f97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:15:46 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c06763-928c-442d-9c34-1de0d794ffd7]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ca9deb60-9474-4bdd-b2a0-874b84664036 tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:46 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97 Jul 14 13:15:46 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:46 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5595a78a-8b4b-420c-a1a7-c0bf85f10d51 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.23806120-0485-4bde-8e7c-0c22542d7e8e 1G" returned: 0 in 0.448s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5595a78a-8b4b-420c-a1a7-c0bf85f10d51 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.23806120-0485-4bde-8e7c-0c22542d7e8e {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:46 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.23806120-0485-4bde-8e7c-0c22542d7e8e Jul 14 13:15:46 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:46 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ca9deb60-9474-4bdd-b2a0-874b84664036 tempest-VolumeDependencyTests-168015083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97" returned: 0 in 0.486s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ca9deb60-9474-4bdd-b2a0-874b84664036 tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:46 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206 Jul 14 13:15:46 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-50c8e861-994b-4d3c-b2ee-0127a0e6edc8 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:46 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5595a78a-8b4b-420c-a1a7-c0bf85f10d51 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.23806120-0485-4bde-8e7c-0c22542d7e8e" returned: 0 in 0.421s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:46 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-5595a78a-8b4b-420c-a1a7-c0bf85f10d51 tempest-ProjectReaderTests-992783010 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.23806120-0485-4bde-8e7c-0c22542d7e8e is being set with open permissions: ugo+rw Jul 14 13:15:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5595a78a-8b4b-420c-a1a7-c0bf85f10d51 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.23806120-0485-4bde-8e7c-0c22542d7e8e {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:46 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.23806120-0485-4bde-8e7c-0c22542d7e8e Jul 14 13:15:46 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:47 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ca9deb60-9474-4bdd-b2a0-874b84664036 tempest-VolumeDependencyTests-168015083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206" returned: 0 in 0.426s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ca9deb60-9474-4bdd-b2a0-874b84664036 tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:47 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206 Jul 14 13:15:47 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:47 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5595a78a-8b4b-420c-a1a7-c0bf85f10d51 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.23806120-0485-4bde-8e7c-0c22542d7e8e" returned: 0 in 0.278s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5595a78a-8b4b-420c-a1a7-c0bf85f10d51 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:47 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.info Jul 14 13:15:47 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:47 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ca9deb60-9474-4bdd-b2a0-874b84664036 tempest-VolumeDependencyTests-168015083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97.75eb273d-8890-4258-aa5e-74fb8c658206" returned: 0 in 0.262s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ca9deb60-9474-4bdd-b2a0-874b84664036 tempest-VolumeDependencyTests-168015083 None] Lock "cinder-quobyte-75eb273d-8890-4258-aa5e-74fb8c658206" released by "_delete_snapshot" :: held 1.698s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ca9deb60-9474-4bdd-b2a0-874b84664036 tempest-VolumeDependencyTests-168015083 None] Lock "cinder-quobyte-891c8bb2-091a-4f6a-836f-b89120611f97" released by "delete_snapshot" :: held 1.724s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:47 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5595a78a-8b4b-420c-a1a7-c0bf85f10d51 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.info" returned: 0 in 0.273s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:47 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-5595a78a-8b4b-420c-a1a7-c0bf85f10d51 tempest-ProjectReaderTests-992783010 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.info is being set with open permissions: ugo+rw Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5595a78a-8b4b-420c-a1a7-c0bf85f10d51 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:47 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.info Jul 14 13:15:47 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-ca9deb60-9474-4bdd-b2a0-874b84664036 tempest-VolumeDependencyTests-168015083 None] Created reservations ['729bfb4d-30fb-4f2f-a795-293f344436c5', '980897a5-cbc0-4bdb-8644-c5365a76672c', '79dfbee5-c883-43ef-b740-a79155e0848c', 'e7dd1a88-7f0a-474c-bcf5-307f6a25b1dd'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:47 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-ca9deb60-9474-4bdd-b2a0-874b84664036 tempest-VolumeDependencyTests-168015083 None] Delete snapshot completed successfully. Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ca9deb60-9474-4bdd-b2a0-874b84664036 tempest-VolumeDependencyTests-168015083 None] Lock "cinder-75eb273d-8890-4258-aa5e-74fb8c658206-delete_snapshot" released by "delete_snapshot" :: held 1.942s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:47 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5595a78a-8b4b-420c-a1a7-c0bf85f10d51 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.info" returned: 0 in 0.266s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5595a78a-8b4b-420c-a1a7-c0bf85f10d51 tempest-ProjectReaderTests-992783010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.217s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-50c8e861-994b-4d3c-b2ee-0127a0e6edc8 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.946s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-50c8e861-994b-4d3c-b2ee-0127a0e6edc8 tempest-ProjectMemberTests-1712779975 None] Creating offline snapshot 22710882-9b90-4790-b89d-39b0ad7473c2 of volume 6de544c1-4013-4396-b7a3-0d66e3e826ba {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:15:47 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-5595a78a-8b4b-420c-a1a7-c0bf85f10d51 tempest-ProjectReaderTests-992783010 None] Create snapshot completed successfully Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[241cc836-b239-439f-be74-d666061470f1]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-50c8e861-994b-4d3c-b2ee-0127a0e6edc8 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1ef97f52-ab72-4fda-b4cd-729368967ffa tempest-VolumeDependencyTests-168015083 None] Acquiring lock "cinder-891c8bb2-091a-4f6a-836f-b89120611f97-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1ef97f52-ab72-4fda-b4cd-729368967ffa tempest-VolumeDependencyTests-168015083 None] Lock "cinder-891c8bb2-091a-4f6a-836f-b89120611f97-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:47 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba Jul 14 13:15:47 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1ef97f52-ab72-4fda-b4cd-729368967ffa tempest-VolumeDependencyTests-168015083 None] Acquiring lock "cinder-quobyte-891c8bb2-091a-4f6a-836f-b89120611f97" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1ef97f52-ab72-4fda-b4cd-729368967ffa tempest-VolumeDependencyTests-168015083 None] Lock "cinder-quobyte-891c8bb2-091a-4f6a-836f-b89120611f97" acquired by "delete_volume" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[588b7bc3-9aeb-4640-a22f-2b55c1b2fe7e]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1ef97f52-ab72-4fda-b4cd-729368967ffa tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:48 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97 Jul 14 13:15:48 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:48 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-50c8e861-994b-4d3c-b2ee-0127a0e6edc8 tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba" returned: 0 in 0.427s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-50c8e861-994b-4d3c-b2ee-0127a0e6edc8 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.22710882-9b90-4790-b89d-39b0ad7473c2 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:48 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.22710882-9b90-4790-b89d-39b0ad7473c2 1G Jul 14 13:15:48 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:48 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1ef97f52-ab72-4fda-b4cd-729368967ffa tempest-VolumeDependencyTests-168015083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97" returned: 0 in 0.387s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1ef97f52-ab72-4fda-b4cd-729368967ffa tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:48 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97 Jul 14 13:15:48 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:48 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1ef97f52-ab72-4fda-b4cd-729368967ffa tempest-VolumeDependencyTests-168015083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-891c8bb2-091a-4f6a-836f-b89120611f97" returned: 0 in 0.288s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:48 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:48 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1ef97f52-ab72-4fda-b4cd-729368967ffa tempest-VolumeDependencyTests-168015083 None] Lock "cinder-quobyte-891c8bb2-091a-4f6a-836f-b89120611f97" released by "delete_volume" :: held 0.750s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-50c8e861-994b-4d3c-b2ee-0127a0e6edc8 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.22710882-9b90-4790-b89d-39b0ad7473c2 1G" returned: 0 in 0.515s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-50c8e861-994b-4d3c-b2ee-0127a0e6edc8 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de544c1-4013-4396-b7a3-0d66e3e826ba -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.22710882-9b90-4790-b89d-39b0ad7473c2 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:48 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de544c1-4013-4396-b7a3-0d66e3e826ba -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.22710882-9b90-4790-b89d-39b0ad7473c2 Jul 14 13:15:48 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:48 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-1ef97f52-ab72-4fda-b4cd-729368967ffa tempest-VolumeDependencyTests-168015083 None] Created reservations ['4844c637-e8ab-47bc-ae0a-d9b5514fc930', '0efb496a-0ae4-4386-ae9b-c8efdfba5eea', '32ac1374-8c51-4b72-a21e-d7ace9d4126d', '2c89bc09-8777-42fe-b3e1-3a3057107a7d'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1ef97f52-ab72-4fda-b4cd-729368967ffa tempest-VolumeDependencyTests-168015083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1ef97f52-ab72-4fda-b4cd-729368967ffa tempest-VolumeDependencyTests-168015083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:48 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1ef97f52-ab72-4fda-b4cd-729368967ffa tempest-VolumeDependencyTests-168015083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:48 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-1ef97f52-ab72-4fda-b4cd-729368967ffa tempest-VolumeDependencyTests-168015083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-1ef97f52-ab72-4fda-b4cd-729368967ffa tempest-VolumeDependencyTests-168015083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1ef97f52-ab72-4fda-b4cd-729368967ffa tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:48 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:48 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a24105c1-70b5-41f2-a13f-55508a5e05d3 tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-23806120-0485-4bde-8e7c-0c22542d7e8e-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-cd828f1e-3e0d-4d1b-991c-2fad946d8b6d tempest-VolumeDependencyTests-168015083 None] Acquiring lock "cinder-7e53afb8-1b93-4a02-b76b-448e0b2a7e73-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a24105c1-70b5-41f2-a13f-55508a5e05d3 tempest-ProjectReaderTests-992783010 None] Lock "cinder-23806120-0485-4bde-8e7c-0c22542d7e8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a24105c1-70b5-41f2-a13f-55508a5e05d3 tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-quobyte-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-cd828f1e-3e0d-4d1b-991c-2fad946d8b6d tempest-VolumeDependencyTests-168015083 None] Lock "cinder-7e53afb8-1b93-4a02-b76b-448e0b2a7e73-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a24105c1-70b5-41f2-a13f-55508a5e05d3 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a24105c1-70b5-41f2-a13f-55508a5e05d3 tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-quobyte-23806120-0485-4bde-8e7c-0c22542d7e8e" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:49 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-50c8e861-994b-4d3c-b2ee-0127a0e6edc8 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de544c1-4013-4396-b7a3-0d66e3e826ba -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.22710882-9b90-4790-b89d-39b0ad7473c2" returned: 0 in 0.468s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:49 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-50c8e861-994b-4d3c-b2ee-0127a0e6edc8 tempest-ProjectMemberTests-1712779975 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.22710882-9b90-4790-b89d-39b0ad7473c2 is being set with open permissions: ugo+rw Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-50c8e861-994b-4d3c-b2ee-0127a0e6edc8 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.22710882-9b90-4790-b89d-39b0ad7473c2 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a24105c1-70b5-41f2-a13f-55508a5e05d3 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-23806120-0485-4bde-8e7c-0c22542d7e8e" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:49 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.22710882-9b90-4790-b89d-39b0ad7473c2 Jul 14 13:15:49 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-a24105c1-70b5-41f2-a13f-55508a5e05d3 tempest-ProjectReaderTests-992783010 None] Deleting offline snapshot 23806120-0485-4bde-8e7c-0c22542d7e8e of volume f6f3966d-f4d6-43a4-b2fd-8e188c75cf06 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-a24105c1-70b5-41f2-a13f-55508a5e05d3 tempest-ProjectReaderTests-992783010 None] snapshot_file for this snap is: volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.23806120-0485-4bde-8e7c-0c22542d7e8e {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-cd828f1e-3e0d-4d1b-991c-2fad946d8b6d tempest-VolumeDependencyTests-168015083 None] Acquiring lock "cinder-quobyte-7e53afb8-1b93-4a02-b76b-448e0b2a7e73" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c03a89-c834-4ead-b772-6f9e5f968bff]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a24105c1-70b5-41f2-a13f-55508a5e05d3 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.23806120-0485-4bde-8e7c-0c22542d7e8e {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-cd828f1e-3e0d-4d1b-991c-2fad946d8b6d tempest-VolumeDependencyTests-168015083 None] Lock "cinder-quobyte-7e53afb8-1b93-4a02-b76b-448e0b2a7e73" acquired by "delete_volume" :: waited 0.053s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e438846-ae2d-437c-8e0a-f22f8da496bc]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cd828f1e-3e0d-4d1b-991c-2fad946d8b6d tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7e53afb8-1b93-4a02-b76b-448e0b2a7e73 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:49 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-1ef97f52-ab72-4fda-b4cd-729368967ffa tempest-VolumeDependencyTests-168015083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.497s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:49 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.23806120-0485-4bde-8e7c-0c22542d7e8e Jul 14 13:15:49 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-1ef97f52-ab72-4fda-b4cd-729368967ffa tempest-VolumeDependencyTests-168015083 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:49 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-1ef97f52-ab72-4fda-b4cd-729368967ffa tempest-VolumeDependencyTests-168015083 None] Deleted volume successfully. Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-1ef97f52-ab72-4fda-b4cd-729368967ffa tempest-VolumeDependencyTests-168015083 None] Lock "cinder-891c8bb2-091a-4f6a-836f-b89120611f97-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:49 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7e53afb8-1b93-4a02-b76b-448e0b2a7e73 Jul 14 13:15:49 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:49 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-50c8e861-994b-4d3c-b2ee-0127a0e6edc8 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.22710882-9b90-4790-b89d-39b0ad7473c2" returned: 0 in 0.339s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-50c8e861-994b-4d3c-b2ee-0127a0e6edc8 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:49 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.info Jul 14 13:15:49 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:49 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a24105c1-70b5-41f2-a13f-55508a5e05d3 tempest-ProjectReaderTests-992783010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.23806120-0485-4bde-8e7c-0c22542d7e8e" returned: 0 in 0.490s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-a24105c1-70b5-41f2-a13f-55508a5e05d3 tempest-ProjectReaderTests-992783010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[9addd866-6d15-4770-8533-e1a5d7c23cf1]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a24105c1-70b5-41f2-a13f-55508a5e05d3 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:49 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cd828f1e-3e0d-4d1b-991c-2fad946d8b6d tempest-VolumeDependencyTests-168015083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7e53afb8-1b93-4a02-b76b-448e0b2a7e73" returned: 0 in 0.487s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cd828f1e-3e0d-4d1b-991c-2fad946d8b6d tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7e53afb8-1b93-4a02-b76b-448e0b2a7e73 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:49 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7e53afb8-1b93-4a02-b76b-448e0b2a7e73 Jul 14 13:15:49 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:49 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-50c8e861-994b-4d3c-b2ee-0127a0e6edc8 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.info" returned: 0 in 0.373s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:49 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-50c8e861-994b-4d3c-b2ee-0127a0e6edc8 tempest-ProjectMemberTests-1712779975 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.info is being set with open permissions: ugo+rw Jul 14 13:15:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-50c8e861-994b-4d3c-b2ee-0127a0e6edc8 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:49 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.info Jul 14 13:15:49 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:49 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06 Jul 14 13:15:49 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:50 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cd828f1e-3e0d-4d1b-991c-2fad946d8b6d tempest-VolumeDependencyTests-168015083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-7e53afb8-1b93-4a02-b76b-448e0b2a7e73" returned: 0 in 0.339s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:50 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-cd828f1e-3e0d-4d1b-991c-2fad946d8b6d tempest-VolumeDependencyTests-168015083 None] Lock "cinder-quobyte-7e53afb8-1b93-4a02-b76b-448e0b2a7e73" released by "delete_volume" :: held 0.883s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:50 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-50c8e861-994b-4d3c-b2ee-0127a0e6edc8 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.info" returned: 0 in 0.286s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-50c8e861-994b-4d3c-b2ee-0127a0e6edc8 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.533s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:50 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a24105c1-70b5-41f2-a13f-55508a5e05d3 tempest-ProjectReaderTests-992783010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06" returned: 0 in 0.452s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a24105c1-70b5-41f2-a13f-55508a5e05d3 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.23806120-0485-4bde-8e7c-0c22542d7e8e {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:50 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-50c8e861-994b-4d3c-b2ee-0127a0e6edc8 tempest-ProjectMemberTests-1712779975 None] Create snapshot completed successfully Jul 14 13:15:50 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.23806120-0485-4bde-8e7c-0c22542d7e8e Jul 14 13:15:50 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:50 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-cd828f1e-3e0d-4d1b-991c-2fad946d8b6d tempest-VolumeDependencyTests-168015083 None] Created reservations ['8f3b25a7-b749-4cc7-ad4f-32e25b11fccc', '8ae69c3f-30c9-4fb7-bb9c-0e170aac7562', '837e9c62-b580-4dc5-8f11-19d434a74079', '115c0ca9-79a4-4415-ac85-983f955f2d51'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-cd828f1e-3e0d-4d1b-991c-2fad946d8b6d tempest-VolumeDependencyTests-168015083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-cd828f1e-3e0d-4d1b-991c-2fad946d8b6d tempest-VolumeDependencyTests-168015083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-cd828f1e-3e0d-4d1b-991c-2fad946d8b6d tempest-VolumeDependencyTests-168015083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:50 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-cd828f1e-3e0d-4d1b-991c-2fad946d8b6d tempest-VolumeDependencyTests-168015083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-cd828f1e-3e0d-4d1b-991c-2fad946d8b6d tempest-VolumeDependencyTests-168015083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cd828f1e-3e0d-4d1b-991c-2fad946d8b6d tempest-VolumeDependencyTests-168015083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:50 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:50 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:50 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a24105c1-70b5-41f2-a13f-55508a5e05d3 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.23806120-0485-4bde-8e7c-0c22542d7e8e" returned: 0 in 0.398s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a24105c1-70b5-41f2-a13f-55508a5e05d3 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.23806120-0485-4bde-8e7c-0c22542d7e8e {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:50 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cd828f1e-3e0d-4d1b-991c-2fad946d8b6d tempest-VolumeDependencyTests-168015083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.268s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:50 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-cd828f1e-3e0d-4d1b-991c-2fad946d8b6d tempest-VolumeDependencyTests-168015083 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:50 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-cd828f1e-3e0d-4d1b-991c-2fad946d8b6d tempest-VolumeDependencyTests-168015083 None] Deleted volume successfully. Jul 14 13:15:50 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.23806120-0485-4bde-8e7c-0c22542d7e8e Jul 14 13:15:50 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:50 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-cd828f1e-3e0d-4d1b-991c-2fad946d8b6d tempest-VolumeDependencyTests-168015083 None] Lock "cinder-7e53afb8-1b93-4a02-b76b-448e0b2a7e73-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:50 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a24105c1-70b5-41f2-a13f-55508a5e05d3 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06.23806120-0485-4bde-8e7c-0c22542d7e8e" returned: 0 in 0.280s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:50 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a24105c1-70b5-41f2-a13f-55508a5e05d3 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-23806120-0485-4bde-8e7c-0c22542d7e8e" released by "_delete_snapshot" :: held 1.764s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:50 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a24105c1-70b5-41f2-a13f-55508a5e05d3 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06" released by "delete_snapshot" :: held 1.838s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:50 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5ec6aad4-0f21-4e8b-8c7e-2fa23edf0aa4 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-22710882-9b90-4790-b89d-39b0ad7473c2-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5ec6aad4-0f21-4e8b-8c7e-2fa23edf0aa4 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-22710882-9b90-4790-b89d-39b0ad7473c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5ec6aad4-0f21-4e8b-8c7e-2fa23edf0aa4 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-6de544c1-4013-4396-b7a3-0d66e3e826ba" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5ec6aad4-0f21-4e8b-8c7e-2fa23edf0aa4 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-6de544c1-4013-4396-b7a3-0d66e3e826ba" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5ec6aad4-0f21-4e8b-8c7e-2fa23edf0aa4 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-22710882-9b90-4790-b89d-39b0ad7473c2" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5ec6aad4-0f21-4e8b-8c7e-2fa23edf0aa4 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-22710882-9b90-4790-b89d-39b0ad7473c2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-5ec6aad4-0f21-4e8b-8c7e-2fa23edf0aa4 tempest-ProjectMemberTests-1712779975 None] Deleting offline snapshot 22710882-9b90-4790-b89d-39b0ad7473c2 of volume 6de544c1-4013-4396-b7a3-0d66e3e826ba {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-5ec6aad4-0f21-4e8b-8c7e-2fa23edf0aa4 tempest-ProjectMemberTests-1712779975 None] snapshot_file for this snap is: volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.22710882-9b90-4790-b89d-39b0ad7473c2 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46be25e-347c-4b6a-869a-6ec6c3e424f5]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5ec6aad4-0f21-4e8b-8c7e-2fa23edf0aa4 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.22710882-9b90-4790-b89d-39b0ad7473c2 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-a24105c1-70b5-41f2-a13f-55508a5e05d3 tempest-ProjectReaderTests-992783010 None] Created reservations ['381fea3a-06f7-4624-9613-42e679dfd3c5', 'c7955c20-6346-454d-be56-0856c28a0990', '4471e580-5766-42be-9f55-b327b9f5332e', '82c83f56-9ec2-4b92-b85d-ebe4dfc2c6e9'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:51 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-a24105c1-70b5-41f2-a13f-55508a5e05d3 tempest-ProjectReaderTests-992783010 None] Delete snapshot completed successfully. Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a24105c1-70b5-41f2-a13f-55508a5e05d3 tempest-ProjectReaderTests-992783010 None] Lock "cinder-23806120-0485-4bde-8e7c-0c22542d7e8e-delete_snapshot" released by "delete_snapshot" :: held 2.116s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:51 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.22710882-9b90-4790-b89d-39b0ad7473c2 Jul 14 13:15:51 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-535965e9-779a-48bc-881c-c57b8017aa95 tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-535965e9-779a-48bc-881c-c57b8017aa95 tempest-ProjectReaderTests-992783010 None] Lock "cinder-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-535965e9-779a-48bc-881c-c57b8017aa95 tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-quobyte-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-535965e9-779a-48bc-881c-c57b8017aa95 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06" acquired by "delete_volume" :: waited 0.038s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[154f237a-2d96-4f45-bc9c-1005ecae6996]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-535965e9-779a-48bc-881c-c57b8017aa95 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:51 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5ec6aad4-0f21-4e8b-8c7e-2fa23edf0aa4 tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.22710882-9b90-4790-b89d-39b0ad7473c2" returned: 0 in 0.499s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-5ec6aad4-0f21-4e8b-8c7e-2fa23edf0aa4 tempest-ProjectMemberTests-1712779975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6de544c1-4013-4396-b7a3-0d66e3e826ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:15:51 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06 Jul 14 13:15:51 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f85070e-5ea0-4a33-8ffa-b8bf99e3e8b0]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5ec6aad4-0f21-4e8b-8c7e-2fa23edf0aa4 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:51 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba Jul 14 13:15:51 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:51 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-535965e9-779a-48bc-881c-c57b8017aa95 tempest-ProjectReaderTests-992783010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06" returned: 0 in 0.420s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-535965e9-779a-48bc-881c-c57b8017aa95 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:51 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06 Jul 14 13:15:51 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:52 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5ec6aad4-0f21-4e8b-8c7e-2fa23edf0aa4 tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba" returned: 0 in 0.420s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5ec6aad4-0f21-4e8b-8c7e-2fa23edf0aa4 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.22710882-9b90-4790-b89d-39b0ad7473c2 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:52 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.22710882-9b90-4790-b89d-39b0ad7473c2 Jul 14 13:15:52 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:52 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-535965e9-779a-48bc-881c-c57b8017aa95 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06" returned: 0 in 0.312s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:52 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-535965e9-779a-48bc-881c-c57b8017aa95 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06" released by "delete_volume" :: held 0.811s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:52 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-535965e9-779a-48bc-881c-c57b8017aa95 tempest-ProjectReaderTests-992783010 None] Created reservations ['c03b2327-6bae-4f01-a38b-0847a4f37337', '98d4e7d4-7f60-4c6d-a5f6-5d28d1d150bf', '14b16afa-bfc2-4acb-81ac-79fe0a1830eb', '4edf34dc-42d5-4c90-b922-0ddb39e8f9f7'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-535965e9-779a-48bc-881c-c57b8017aa95 tempest-ProjectReaderTests-992783010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-535965e9-779a-48bc-881c-c57b8017aa95 tempest-ProjectReaderTests-992783010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-535965e9-779a-48bc-881c-c57b8017aa95 tempest-ProjectReaderTests-992783010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-535965e9-779a-48bc-881c-c57b8017aa95 tempest-ProjectReaderTests-992783010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-535965e9-779a-48bc-881c-c57b8017aa95 tempest-ProjectReaderTests-992783010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-535965e9-779a-48bc-881c-c57b8017aa95 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:52 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:52 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:52 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5ec6aad4-0f21-4e8b-8c7e-2fa23edf0aa4 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.22710882-9b90-4790-b89d-39b0ad7473c2" returned: 0 in 0.580s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5ec6aad4-0f21-4e8b-8c7e-2fa23edf0aa4 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.22710882-9b90-4790-b89d-39b0ad7473c2 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:52 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.22710882-9b90-4790-b89d-39b0ad7473c2 Jul 14 13:15:52 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:52 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-535965e9-779a-48bc-881c-c57b8017aa95 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.347s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:52 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-535965e9-779a-48bc-881c-c57b8017aa95 tempest-ProjectReaderTests-992783010 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:52 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-535965e9-779a-48bc-881c-c57b8017aa95 tempest-ProjectReaderTests-992783010 None] Deleted volume successfully. Jul 14 13:15:52 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-535965e9-779a-48bc-881c-c57b8017aa95 tempest-ProjectReaderTests-992783010 None] Lock "cinder-f6f3966d-f4d6-43a4-b2fd-8e188c75cf06-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:53 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5ec6aad4-0f21-4e8b-8c7e-2fa23edf0aa4 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba.22710882-9b90-4790-b89d-39b0ad7473c2" returned: 0 in 0.402s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5ec6aad4-0f21-4e8b-8c7e-2fa23edf0aa4 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-22710882-9b90-4790-b89d-39b0ad7473c2" released by "_delete_snapshot" :: held 2.045s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5ec6aad4-0f21-4e8b-8c7e-2fa23edf0aa4 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-6de544c1-4013-4396-b7a3-0d66e3e826ba" released by "delete_snapshot" :: held 2.079s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-5ec6aad4-0f21-4e8b-8c7e-2fa23edf0aa4 tempest-ProjectMemberTests-1712779975 None] Created reservations ['f22e8b33-3eb6-4933-9ec5-4b1f93a05c9a', '34a42443-25cd-4f18-80fd-71f3faa67988', '62f1f018-337e-4f55-b352-41ef40ae4b64', '0fe9036e-d8d5-4c3b-819e-b88891c3d44a'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Flow 'volume_create_manager' (3212615c-bc0b-4d4a-b745-6aa09eb15723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068ab8df-d782-469b-970c-61ca0a9ca527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068ab8df-d782-469b-970c-61ca0a9ca527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2006006348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0362006-9f7e-4ccc-8d74-0ef70c20c8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19db12207814faab3331e1ae1fbcdca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:53Z,use_quota=True,user_id='e4d8cf14566c4c4eb638a53175c20e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ac0979-4569-44bb-841e-ec234b2692a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ac0979-4569-44bb-841e-ec234b2692a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ca3912-55c2-4c9f-9f84-eb1e808edbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ca3912-55c2-4c9f-9f84-eb1e808edbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0362006-9f7e-4ccc-8d74-0ef70c20c8be', 'volume_name': 'volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e236cf-7d08-430c-a32c-6b7ce438c894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e236cf-7d08-430c-a32c-6b7ce438c894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d8de49-ee65-420e-8de6-daaff6472128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:53 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Volume c0362006-9f7e-4ccc-8d74-0ef70c20c8be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be', 'volume_size': 1} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2006006348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0362006-9f7e-4ccc-8d74-0ef70c20c8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19db12207814faab3331e1ae1fbcdca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:53Z,use_quota=True,user_id='e4d8cf14566c4c4eb638a53175c20e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Creating volume c0362006-9f7e-4ccc-8d74-0ef70c20c8be {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:53 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:53 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be 1073741824 Jul 14 13:15:53 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:53 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-5ec6aad4-0f21-4e8b-8c7e-2fa23edf0aa4 tempest-ProjectMemberTests-1712779975 None] Delete snapshot completed successfully. Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-5ec6aad4-0f21-4e8b-8c7e-2fa23edf0aa4 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-22710882-9b90-4790-b89d-39b0ad7473c2-delete_snapshot" released by "delete_snapshot" :: held 2.504s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:53 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be 1073741824" returned: 0 in 0.525s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:54 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be Jul 14 13:15:54 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:54 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a6a03fdf-dbf2-4928-8df2-e419d2c704c7 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-6de544c1-4013-4396-b7a3-0d66e3e826ba-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:54 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be" returned: 0 in 0.347s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:54 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:54 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a6a03fdf-dbf2-4928-8df2-e419d2c704c7 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-6de544c1-4013-4396-b7a3-0d66e3e826ba-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d8de49-ee65-420e-8de6-daaff6472128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e624a4-bb88-4517-91ea-6c1f016694f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:54 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Volume volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be (c0362006-9f7e-4ccc-8d74-0ef70c20c8be): created successfully Jul 14 13:15:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e624a4-bb88-4517-91ea-6c1f016694f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:54 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Flow 'volume_create_manager' (3212615c-bc0b-4d4a-b745-6aa09eb15723) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:54 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a6a03fdf-dbf2-4928-8df2-e419d2c704c7 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-6de544c1-4013-4396-b7a3-0d66e3e826ba" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:54 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-ac38a16e-f15d-4898-9bbe-48b77ee93f1a tempest-ProjectReaderTests-992783010 None] Created volume successfully. Jul 14 13:15:54 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a6a03fdf-dbf2-4928-8df2-e419d2c704c7 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-6de544c1-4013-4396-b7a3-0d66e3e826ba" acquired by "delete_volume" :: waited 0.030s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:54 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31370b8-0874-44e1-83ff-23a9c54d4842]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a6a03fdf-dbf2-4928-8df2-e419d2c704c7 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:54 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba Jul 14 13:15:54 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:54 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a6a03fdf-dbf2-4928-8df2-e419d2c704c7 tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba" returned: 0 in 0.431s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a6a03fdf-dbf2-4928-8df2-e419d2c704c7 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:55 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba Jul 14 13:15:55 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:55 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a6a03fdf-dbf2-4928-8df2-e419d2c704c7 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6de544c1-4013-4396-b7a3-0d66e3e826ba" returned: 0 in 0.320s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a6a03fdf-dbf2-4928-8df2-e419d2c704c7 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-6de544c1-4013-4396-b7a3-0d66e3e826ba" released by "delete_volume" :: held 0.839s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-a6a03fdf-dbf2-4928-8df2-e419d2c704c7 tempest-ProjectMemberTests-1712779975 None] Created reservations ['1fe8051c-cb47-4851-b620-d8312f8337e9', 'ca137c6a-fc00-475a-a85b-835bcff81744', '85ba6238-ad3e-4bcc-b3b8-42d6dac04265', 'bc7e9c8f-f8d2-4cd3-ae35-437dd2e1aef4'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a6a03fdf-dbf2-4928-8df2-e419d2c704c7 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a6a03fdf-dbf2-4928-8df2-e419d2c704c7 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a6a03fdf-dbf2-4928-8df2-e419d2c704c7 tempest-ProjectMemberTests-1712779975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-a6a03fdf-dbf2-4928-8df2-e419d2c704c7 tempest-ProjectMemberTests-1712779975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a6a03fdf-dbf2-4928-8df2-e419d2c704c7 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a6a03fdf-dbf2-4928-8df2-e419d2c704c7 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:55 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:15:55 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Flow 'volume_create_manager' (7d11666c-ffcb-40b5-9078-226af4606ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730d2830-57e7-48ee-9c1e-a21fbc794372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-768bb6c7-c338-45d0-8b63-85a1487be991 tempest-ProjectReaderTests-992783010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-768bb6c7-c338-45d0-8b63-85a1487be991 tempest-ProjectReaderTests-992783010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730d2830-57e7-48ee-9c1e-a21fbc794372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea2d234-8a35-45d2-97ff-9a2f817c3bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0443e32a1bef4a5fb9517f49b9306454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:56Z,use_quota=True,user_id='a11653802cf4448abf7d25d48779675b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e633cdc2-1619-46fe-81c6-f4319d3e828d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e633cdc2-1619-46fe-81c6-f4319d3e828d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a49c3ad4-b843-4b5f-bd06-60633dad16f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a49c3ad4-b843-4b5f-bd06-60633dad16f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dea2d234-8a35-45d2-97ff-9a2f817c3bfc', 'volume_name': 'volume-dea2d234-8a35-45d2-97ff-9a2f817c3bfc', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9e4cb3-ac4d-4941-b34b-36f9c6372f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9e4cb3-ac4d-4941-b34b-36f9c6372f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a50d616-4163-44b9-a57f-1926421449c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:55 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Volume dea2d234-8a35-45d2-97ff-9a2f817c3bfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dea2d234-8a35-45d2-97ff-9a2f817c3bfc', 'volume_size': 1} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-768bb6c7-c338-45d0-8b63-85a1487be991 tempest-ProjectReaderTests-992783010 None] Creating offline snapshot d988558c-7170-4b32-b69b-d9365bbee800 of volume c0362006-9f7e-4ccc-8d74-0ef70c20c8be {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:15:55 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a6a03fdf-dbf2-4928-8df2-e419d2c704c7 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.356s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-a6a03fdf-dbf2-4928-8df2-e419d2c704c7 tempest-ProjectMemberTests-1712779975 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0af6bc-63bb-4bde-93eb-4e982e794b32]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-768bb6c7-c338-45d0-8b63-85a1487be991 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:55 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-a6a03fdf-dbf2-4928-8df2-e419d2c704c7 tempest-ProjectMemberTests-1712779975 None] Deleted volume successfully. Jul 14 13:15:55 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-a6a03fdf-dbf2-4928-8df2-e419d2c704c7 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-6de544c1-4013-4396-b7a3-0d66e3e826ba-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:15:56 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be Jul 14 13:15:56 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:56 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:15:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Flow 'volume_create_manager' (9f332fe8-ef47-48e8-9d2d-65707793ec55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251884af-8ae3-46d6-858e-45f516587081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251884af-8ae3-46d6-858e-45f516587081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-880582928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c416d0a-c4b1-4a30-8540-08267118b18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ce77d922d74f64be5aceab89b43e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:56Z,use_quota=True,user_id='a8d39912638c4ab594816189250d21e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d2a72dd-ad54-412d-89c7-523572021c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d2a72dd-ad54-412d-89c7-523572021c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bc68cf9-cfa8-4ff7-bee9-8846cb262432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bc68cf9-cfa8-4ff7-bee9-8846cb262432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c416d0a-c4b1-4a30-8540-08267118b18d', 'volume_name': 'volume-3c416d0a-c4b1-4a30-8540-08267118b18d', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e225678-b9b3-48de-b787-1f176a25633b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e225678-b9b3-48de-b787-1f176a25633b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:56 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2d797c-4631-4fef-ba39-99e8acf10828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:56 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Volume 3c416d0a-c4b1-4a30-8540-08267118b18d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c416d0a-c4b1-4a30-8540-08267118b18d', 'volume_size': 1} Jul 14 13:15:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:56 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-768bb6c7-c338-45d0-8b63-85a1487be991 tempest-ProjectReaderTests-992783010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be" returned: 0 in 0.405s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-768bb6c7-c338-45d0-8b63-85a1487be991 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.d988558c-7170-4b32-b69b-d9365bbee800 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:56 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.d988558c-7170-4b32-b69b-d9365bbee800 1G Jul 14 13:15:56 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:56 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-768bb6c7-c338-45d0-8b63-85a1487be991 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.d988558c-7170-4b32-b69b-d9365bbee800 1G" returned: 0 in 0.447s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:56 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-768bb6c7-c338-45d0-8b63-85a1487be991 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.d988558c-7170-4b32-b69b-d9365bbee800 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:56 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.d988558c-7170-4b32-b69b-d9365bbee800 Jul 14 13:15:56 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:57 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-768bb6c7-c338-45d0-8b63-85a1487be991 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.d988558c-7170-4b32-b69b-d9365bbee800" returned: 0 in 0.313s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:57 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-768bb6c7-c338-45d0-8b63-85a1487be991 tempest-ProjectReaderTests-992783010 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.d988558c-7170-4b32-b69b-d9365bbee800 is being set with open permissions: ugo+rw Jul 14 13:15:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-768bb6c7-c338-45d0-8b63-85a1487be991 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.d988558c-7170-4b32-b69b-d9365bbee800 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:57 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.d988558c-7170-4b32-b69b-d9365bbee800 Jul 14 13:15:57 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:57 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-768bb6c7-c338-45d0-8b63-85a1487be991 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.d988558c-7170-4b32-b69b-d9365bbee800" returned: 0 in 0.251s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-768bb6c7-c338-45d0-8b63-85a1487be991 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:57 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.info Jul 14 13:15:57 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:57 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-768bb6c7-c338-45d0-8b63-85a1487be991 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.info" returned: 0 in 0.271s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:57 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-768bb6c7-c338-45d0-8b63-85a1487be991 tempest-ProjectReaderTests-992783010 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.info is being set with open permissions: ugo+rw Jul 14 13:15:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-768bb6c7-c338-45d0-8b63-85a1487be991 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:57 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.info Jul 14 13:15:57 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:57 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-768bb6c7-c338-45d0-8b63-85a1487be991 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.info" returned: 0 in 0.253s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-768bb6c7-c338-45d0-8b63-85a1487be991 tempest-ProjectReaderTests-992783010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.094s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.036s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea2d234-8a35-45d2-97ff-9a2f817c3bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0443e32a1bef4a5fb9517f49b9306454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:56Z,use_quota=True,user_id='a11653802cf4448abf7d25d48779675b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Creating volume dea2d234-8a35-45d2-97ff-9a2f817c3bfc {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:57 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:57 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:57 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dea2d234-8a35-45d2-97ff-9a2f817c3bfc 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:57 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dea2d234-8a35-45d2-97ff-9a2f817c3bfc 1073741824 Jul 14 13:15:57 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:57 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-768bb6c7-c338-45d0-8b63-85a1487be991 tempest-ProjectReaderTests-992783010 None] Create snapshot completed successfully Jul 14 13:15:58 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dea2d234-8a35-45d2-97ff-9a2f817c3bfc 1073741824" returned: 0 in 0.476s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dea2d234-8a35-45d2-97ff-9a2f817c3bfc {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:58 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dea2d234-8a35-45d2-97ff-9a2f817c3bfc Jul 14 13:15:58 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-105a047b-a2a2-486f-9be6-f471fddccf53 tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-d988558c-7170-4b32-b69b-d9365bbee800-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:58 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dea2d234-8a35-45d2-97ff-9a2f817c3bfc" returned: 0 in 0.267s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.479s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-880582928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c416d0a-c4b1-4a30-8540-08267118b18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ce77d922d74f64be5aceab89b43e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:15:56Z,use_quota=True,user_id='a8d39912638c4ab594816189250d21e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Creating volume 3c416d0a-c4b1-4a30-8540-08267118b18d {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:15:58 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:58 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d 1073741824 Jul 14 13:15:58 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a50d616-4163-44b9-a57f-1926421449c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dea2d234-8a35-45d2-97ff-9a2f817c3bfc', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e643ae50-349d-4e73-8116-1d02644f5a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-105a047b-a2a2-486f-9be6-f471fddccf53 tempest-ProjectReaderTests-992783010 None] Lock "cinder-d988558c-7170-4b32-b69b-d9365bbee800-delete_snapshot" acquired by "delete_snapshot" :: waited 0.111s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-105a047b-a2a2-486f-9be6-f471fddccf53 tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-quobyte-c0362006-9f7e-4ccc-8d74-0ef70c20c8be" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:58 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Volume volume-dea2d234-8a35-45d2-97ff-9a2f817c3bfc (dea2d234-8a35-45d2-97ff-9a2f817c3bfc): created successfully Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e643ae50-349d-4e73-8116-1d02644f5a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Flow 'volume_create_manager' (7d11666c-ffcb-40b5-9078-226af4606ebe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-105a047b-a2a2-486f-9be6-f471fddccf53 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-c0362006-9f7e-4ccc-8d74-0ef70c20c8be" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-105a047b-a2a2-486f-9be6-f471fddccf53 tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-quobyte-d988558c-7170-4b32-b69b-d9365bbee800" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:15:58 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-5e4eb50f-976e-48f3-a0d9-85416ce68deb tempest-CinderUnicodeTest-1479212601 None] Created volume successfully. Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-105a047b-a2a2-486f-9be6-f471fddccf53 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-d988558c-7170-4b32-b69b-d9365bbee800" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-105a047b-a2a2-486f-9be6-f471fddccf53 tempest-ProjectReaderTests-992783010 None] Deleting offline snapshot d988558c-7170-4b32-b69b-d9365bbee800 of volume c0362006-9f7e-4ccc-8d74-0ef70c20c8be {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-105a047b-a2a2-486f-9be6-f471fddccf53 tempest-ProjectReaderTests-992783010 None] snapshot_file for this snap is: volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.d988558c-7170-4b32-b69b-d9365bbee800 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c17e4bc-99d3-41b8-b6b5-d4dbe394aba3]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:58 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-105a047b-a2a2-486f-9be6-f471fddccf53 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.d988558c-7170-4b32-b69b-d9365bbee800 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:59 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.d988558c-7170-4b32-b69b-d9365bbee800 Jul 14 13:15:59 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:59 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d 1073741824" returned: 0 in 0.505s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:59 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:UPDATE=319,cinder:SELECT=220,cinder:INSERT=81,cinder:DELETE=33 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:15:59 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-105a047b-a2a2-486f-9be6-f471fddccf53 tempest-ProjectReaderTests-992783010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.d988558c-7170-4b32-b69b-d9365bbee800" returned: 0 in 0.393s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-105a047b-a2a2-486f-9be6-f471fddccf53 tempest-ProjectReaderTests-992783010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:15:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:59 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ad8cea-e68e-4510-8a5d-62ced64c75de]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:15:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-105a047b-a2a2-486f-9be6-f471fddccf53 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:59 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d Jul 14 13:15:59 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:59 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be Jul 14 13:15:59 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:15:59 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d" returned: 0 in 0.267s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:15:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:15:59 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=241,cinder:UPDATE=302,cinder:INSERT=86,cinder:DELETE=23 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:15:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2d797c-4631-4fef-ba39-99e8acf10828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c416d0a-c4b1-4a30-8540-08267118b18d', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78012e9-cad7-42e7-a75d-8fbd62b42660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:15:59 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Volume volume-3c416d0a-c4b1-4a30-8540-08267118b18d (3c416d0a-c4b1-4a30-8540-08267118b18d): created successfully Jul 14 13:15:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78012e9-cad7-42e7-a75d-8fbd62b42660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:15:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Flow 'volume_create_manager' (9f332fe8-ef47-48e8-9d2d-65707793ec55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:15:59 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-f5d2b257-c0e0-4c92-b062-8ec86327a116 tempest-ProjectMemberTests-1712779975 None] Created volume successfully. Jul 14 13:15:59 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 14 13:15:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-105a047b-a2a2-486f-9be6-f471fddccf53 tempest-ProjectReaderTests-992783010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be" returned: 0 in 0.423s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:15:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-105a047b-a2a2-486f-9be6-f471fddccf53 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.d988558c-7170-4b32-b69b-d9365bbee800 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:15:59 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.d988558c-7170-4b32-b69b-d9365bbee800 Jul 14 13:15:59 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:00 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-105a047b-a2a2-486f-9be6-f471fddccf53 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.d988558c-7170-4b32-b69b-d9365bbee800" returned: 0 in 0.395s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-105a047b-a2a2-486f-9be6-f471fddccf53 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.d988558c-7170-4b32-b69b-d9365bbee800 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:00 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.d988558c-7170-4b32-b69b-d9365bbee800 Jul 14 13:16:00 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:00 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-105a047b-a2a2-486f-9be6-f471fddccf53 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be.d988558c-7170-4b32-b69b-d9365bbee800" returned: 0 in 0.327s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-105a047b-a2a2-486f-9be6-f471fddccf53 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-d988558c-7170-4b32-b69b-d9365bbee800" released by "_delete_snapshot" :: held 1.678s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-105a047b-a2a2-486f-9be6-f471fddccf53 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-c0362006-9f7e-4ccc-8d74-0ef70c20c8be" released by "delete_snapshot" :: held 1.711s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Flow 'volume_create_manager' (362c772b-a4da-4ac5-b3e4-0be423bce7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0915a68d-8782-4630-8e52-a90b325c3199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0915a68d-8782-4630-8e52-a90b325c3199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:16:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1214074351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f832a5-a558-41a1-b3e7-2162600f0358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0443e32a1bef4a5fb9517f49b9306454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:16:01Z,use_quota=True,user_id='a11653802cf4448abf7d25d48779675b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bdd03ec-9596-4de4-893c-86f0652f55d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bdd03ec-9596-4de4-893c-86f0652f55d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ed1a6f-1663-4978-9f3b-ef1cc705b532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ed1a6f-1663-4978-9f3b-ef1cc705b532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14f832a5-a558-41a1-b3e7-2162600f0358', 'volume_name': 'volume-14f832a5-a558-41a1-b3e7-2162600f0358', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d359e36a-9c6c-43cd-8da8-74e968a23a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d359e36a-9c6c-43cd-8da8-74e968a23a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3e3a42-28e6-44e3-87c5-d50c744044f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:00 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Volume 14f832a5-a558-41a1-b3e7-2162600f0358: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14f832a5-a558-41a1-b3e7-2162600f0358', 'volume_size': 1} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:16:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1214074351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f832a5-a558-41a1-b3e7-2162600f0358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0443e32a1bef4a5fb9517f49b9306454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:16:01Z,use_quota=True,user_id='a11653802cf4448abf7d25d48779675b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Creating volume 14f832a5-a558-41a1-b3e7-2162600f0358 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:16:00 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:00 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358 1073741824 Jul 14 13:16:00 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-85ea9c02-4425-4241-91f7-79ec480d8ea4 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-105a047b-a2a2-486f-9be6-f471fddccf53 tempest-ProjectReaderTests-992783010 None] Created reservations ['2509efeb-30ba-4011-8cd8-6a0662ec0ede', 'e3be0238-9ac5-4ddc-9f68-dec1b7d045d5', '789d8996-5a39-44fc-9386-ccda95aae432', '0bd31964-2d84-454d-8f63-869a140b56ab'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:00 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-105a047b-a2a2-486f-9be6-f471fddccf53 tempest-ProjectReaderTests-992783010 None] Delete snapshot completed successfully. Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-105a047b-a2a2-486f-9be6-f471fddccf53 tempest-ProjectReaderTests-992783010 None] Lock "cinder-d988558c-7170-4b32-b69b-d9365bbee800-delete_snapshot" released by "delete_snapshot" :: held 2.057s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-85652c12-ca49-4496-9d09-c15e03c20046 tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-c0362006-9f7e-4ccc-8d74-0ef70c20c8be-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-85652c12-ca49-4496-9d09-c15e03c20046 tempest-ProjectReaderTests-992783010 None] Lock "cinder-c0362006-9f7e-4ccc-8d74-0ef70c20c8be-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-85652c12-ca49-4496-9d09-c15e03c20046 tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-quobyte-c0362006-9f7e-4ccc-8d74-0ef70c20c8be" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-85652c12-ca49-4496-9d09-c15e03c20046 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-c0362006-9f7e-4ccc-8d74-0ef70c20c8be" acquired by "delete_volume" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfc122e-6a49-435e-ae04-3c5a0f29022d]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-85652c12-ca49-4496-9d09-c15e03c20046 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:01 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be Jul 14 13:16:01 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:01 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358 1073741824" returned: 0 in 0.463s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:01 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358 Jul 14 13:16:01 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:01 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-85652c12-ca49-4496-9d09-c15e03c20046 tempest-ProjectReaderTests-992783010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be" returned: 0 in 0.370s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-85652c12-ca49-4496-9d09-c15e03c20046 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:01 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be Jul 14 13:16:01 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:01 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358" returned: 0 in 0.279s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-85ea9c02-4425-4241-91f7-79ec480d8ea4 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.733s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-85ea9c02-4425-4241-91f7-79ec480d8ea4 tempest-ProjectMemberTests-1712779975 None] Creating offline snapshot 5f8e5b30-b9c0-4f78-9b1f-043b302748ed of volume 3c416d0a-c4b1-4a30-8540-08267118b18d {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3e3a42-28e6-44e3-87c5-d50c744044f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14f832a5-a558-41a1-b3e7-2162600f0358', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80eedf02-50ba-4bc0-8cd7-9f7b9c851b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25238f6-c602-4837-b3a2-711582f9abf4]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-85ea9c02-4425-4241-91f7-79ec480d8ea4 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:01 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Volume volume-14f832a5-a558-41a1-b3e7-2162600f0358 (14f832a5-a558-41a1-b3e7-2162600f0358): created successfully Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80eedf02-50ba-4bc0-8cd7-9f7b9c851b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Flow 'volume_create_manager' (362c772b-a4da-4ac5-b3e4-0be423bce7f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:16:01 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-39a5fd21-810a-4604-b970-6325e7da3a84 tempest-CinderUnicodeTest-1479212601 None] Created volume successfully. Jul 14 13:16:01 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-85652c12-ca49-4496-9d09-c15e03c20046 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c0362006-9f7e-4ccc-8d74-0ef70c20c8be" returned: 0 in 0.265s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:01 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d Jul 14 13:16:01 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-85652c12-ca49-4496-9d09-c15e03c20046 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-c0362006-9f7e-4ccc-8d74-0ef70c20c8be" released by "delete_volume" :: held 0.696s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-85652c12-ca49-4496-9d09-c15e03c20046 tempest-ProjectReaderTests-992783010 None] Created reservations ['6d53f4cc-8b45-4348-bf35-1811b574af71', 'f81be51c-ae42-4044-a423-9c67dd087108', '6bc7f8ef-d579-4ae4-b9c4-17ee43f09533', 'edad89de-1779-48f2-bec9-fa9eeec5e7ae'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-85652c12-ca49-4496-9d09-c15e03c20046 tempest-ProjectReaderTests-992783010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-85652c12-ca49-4496-9d09-c15e03c20046 tempest-ProjectReaderTests-992783010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-85652c12-ca49-4496-9d09-c15e03c20046 tempest-ProjectReaderTests-992783010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-85652c12-ca49-4496-9d09-c15e03c20046 tempest-ProjectReaderTests-992783010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-85652c12-ca49-4496-9d09-c15e03c20046 tempest-ProjectReaderTests-992783010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-85652c12-ca49-4496-9d09-c15e03c20046 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:01 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:16:01 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:01 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-85ea9c02-4425-4241-91f7-79ec480d8ea4 tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d" returned: 0 in 0.383s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-85ea9c02-4425-4241-91f7-79ec480d8ea4 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.5f8e5b30-b9c0-4f78-9b1f-043b302748ed 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:02 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.5f8e5b30-b9c0-4f78-9b1f-043b302748ed 1G Jul 14 13:16:02 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:02 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-85652c12-ca49-4496-9d09-c15e03c20046 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.271s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:02 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-85652c12-ca49-4496-9d09-c15e03c20046 tempest-ProjectReaderTests-992783010 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:16:02 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-85652c12-ca49-4496-9d09-c15e03c20046 tempest-ProjectReaderTests-992783010 None] Deleted volume successfully. Jul 14 13:16:02 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-85652c12-ca49-4496-9d09-c15e03c20046 tempest-ProjectReaderTests-992783010 None] Lock "cinder-c0362006-9f7e-4ccc-8d74-0ef70c20c8be-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:02 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-85ea9c02-4425-4241-91f7-79ec480d8ea4 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.5f8e5b30-b9c0-4f78-9b1f-043b302748ed 1G" returned: 0 in 0.444s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-85ea9c02-4425-4241-91f7-79ec480d8ea4 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c416d0a-c4b1-4a30-8540-08267118b18d -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.5f8e5b30-b9c0-4f78-9b1f-043b302748ed {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:02 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c416d0a-c4b1-4a30-8540-08267118b18d -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.5f8e5b30-b9c0-4f78-9b1f-043b302748ed Jul 14 13:16:02 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:02 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:16:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Flow 'volume_create_manager' (cfcb129d-3cc7-4808-ab00-50dd4148526b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:16:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2382b09-4a49-488f-ab4f-0a7c7d706969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2382b09-4a49-488f-ab4f-0a7c7d706969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2144333912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5106a2-21c2-440a-89f7-f1d12cd0eb97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19db12207814faab3331e1ae1fbcdca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:16:03Z,use_quota=True,user_id='e4d8cf14566c4c4eb638a53175c20e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6b62a8-5a38-40d2-83da-3b087168ad78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6b62a8-5a38-40d2-83da-3b087168ad78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a380c3-a22e-48df-bb0a-58f18375f6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a380c3-a22e-48df-bb0a-58f18375f6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a5106a2-21c2-440a-89f7-f1d12cd0eb97', 'volume_name': 'volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c33cd64-6118-4ac9-9cd4-c3a12f3b599c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c33cd64-6118-4ac9-9cd4-c3a12f3b599c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f846dffd-bf01-4b63-839f-b1b5b8863f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:02 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Volume 0a5106a2-21c2-440a-89f7-f1d12cd0eb97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97', 'volume_size': 1} Jul 14 13:16:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:02 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-85ea9c02-4425-4241-91f7-79ec480d8ea4 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c416d0a-c4b1-4a30-8540-08267118b18d -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.5f8e5b30-b9c0-4f78-9b1f-043b302748ed" returned: 0 in 0.328s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:02 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-85ea9c02-4425-4241-91f7-79ec480d8ea4 tempest-ProjectMemberTests-1712779975 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.5f8e5b30-b9c0-4f78-9b1f-043b302748ed is being set with open permissions: ugo+rw Jul 14 13:16:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-85ea9c02-4425-4241-91f7-79ec480d8ea4 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.5f8e5b30-b9c0-4f78-9b1f-043b302748ed {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:02 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.5f8e5b30-b9c0-4f78-9b1f-043b302748ed Jul 14 13:16:02 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9ceaf18a-efb6-477f-b90e-f03e05cd960b tempest-CinderUnicodeTest-1479212601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:03 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-85ea9c02-4425-4241-91f7-79ec480d8ea4 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.5f8e5b30-b9c0-4f78-9b1f-043b302748ed" returned: 0 in 0.247s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-85ea9c02-4425-4241-91f7-79ec480d8ea4 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:03 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.info Jul 14 13:16:03 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:03 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-85ea9c02-4425-4241-91f7-79ec480d8ea4 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.info" returned: 0 in 0.245s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:03 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-85ea9c02-4425-4241-91f7-79ec480d8ea4 tempest-ProjectMemberTests-1712779975 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.info is being set with open permissions: ugo+rw Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-85ea9c02-4425-4241-91f7-79ec480d8ea4 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:03 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.info Jul 14 13:16:03 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:03 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-85ea9c02-4425-4241-91f7-79ec480d8ea4 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.info" returned: 0 in 0.239s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-85ea9c02-4425-4241-91f7-79ec480d8ea4 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.980s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.848s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2144333912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5106a2-21c2-440a-89f7-f1d12cd0eb97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19db12207814faab3331e1ae1fbcdca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:16:03Z,use_quota=True,user_id='e4d8cf14566c4c4eb638a53175c20e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Creating volume 0a5106a2-21c2-440a-89f7-f1d12cd0eb97 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:16:03 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:03 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97 1073741824 Jul 14 13:16:03 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:03 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-85ea9c02-4425-4241-91f7-79ec480d8ea4 tempest-ProjectMemberTests-1712779975 None] Create snapshot completed successfully Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-64a0d17f-fbf9-4f44-9c52-19d2aa472fb1 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-5f8e5b30-b9c0-4f78-9b1f-043b302748ed-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-64a0d17f-fbf9-4f44-9c52-19d2aa472fb1 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-5f8e5b30-b9c0-4f78-9b1f-043b302748ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-64a0d17f-fbf9-4f44-9c52-19d2aa472fb1 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-3c416d0a-c4b1-4a30-8540-08267118b18d" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-64a0d17f-fbf9-4f44-9c52-19d2aa472fb1 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-3c416d0a-c4b1-4a30-8540-08267118b18d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-64a0d17f-fbf9-4f44-9c52-19d2aa472fb1 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-5f8e5b30-b9c0-4f78-9b1f-043b302748ed" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-64a0d17f-fbf9-4f44-9c52-19d2aa472fb1 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-5f8e5b30-b9c0-4f78-9b1f-043b302748ed" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-64a0d17f-fbf9-4f44-9c52-19d2aa472fb1 tempest-ProjectMemberTests-1712779975 None] Deleting offline snapshot 5f8e5b30-b9c0-4f78-9b1f-043b302748ed of volume 3c416d0a-c4b1-4a30-8540-08267118b18d {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-64a0d17f-fbf9-4f44-9c52-19d2aa472fb1 tempest-ProjectMemberTests-1712779975 None] snapshot_file for this snap is: volume-3c416d0a-c4b1-4a30-8540-08267118b18d.5f8e5b30-b9c0-4f78-9b1f-043b302748ed {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[415e64c0-4479-4e6f-9b38-89523147da5d]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-64a0d17f-fbf9-4f44-9c52-19d2aa472fb1 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.5f8e5b30-b9c0-4f78-9b1f-043b302748ed {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:04 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97 1073741824" returned: 0 in 0.465s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:04 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97 Jul 14 13:16:04 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:04 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.5f8e5b30-b9c0-4f78-9b1f-043b302748ed Jul 14 13:16:04 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:04 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97" returned: 0 in 0.257s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:16:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9ceaf18a-efb6-477f-b90e-f03e05cd960b tempest-CinderUnicodeTest-1479212601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.345s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f846dffd-bf01-4b63-839f-b1b5b8863f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:04 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0ba32b-18c4-4b6f-bd06-dfbd67c0d1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-64a0d17f-fbf9-4f44-9c52-19d2aa472fb1 tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.5f8e5b30-b9c0-4f78-9b1f-043b302748ed" returned: 0 in 0.368s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-9ceaf18a-efb6-477f-b90e-f03e05cd960b tempest-CinderUnicodeTest-1479212601 None] Creating offline snapshot 12e47f9d-1c0f-40fa-b962-b7d093363654 of volume 14f832a5-a558-41a1-b3e7-2162600f0358 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:16:04 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-64a0d17f-fbf9-4f44-9c52-19d2aa472fb1 tempest-ProjectMemberTests-1712779975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c416d0a-c4b1-4a30-8540-08267118b18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:16:04 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f65da5-a40d-4bce-8055-a832133588c7]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9ceaf18a-efb6-477f-b90e-f03e05cd960b tempest-CinderUnicodeTest-1479212601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:04 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[476f6e9a-aa2c-4590-8b7e-f0d644b2d000]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-64a0d17f-fbf9-4f44-9c52-19d2aa472fb1 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:04 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Volume volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97 (0a5106a2-21c2-440a-89f7-f1d12cd0eb97): created successfully Jul 14 13:16:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0ba32b-18c4-4b6f-bd06-dfbd67c0d1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:04 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Flow 'volume_create_manager' (cfcb129d-3cc7-4808-ab00-50dd4148526b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:16:04 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-93dbc743-2ed7-405b-92c7-5151f92f5bde tempest-ProjectReaderTests-992783010 None] Created volume successfully. Jul 14 13:16:04 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358 Jul 14 13:16:04 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:04 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d Jul 14 13:16:04 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:04 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9ceaf18a-efb6-477f-b90e-f03e05cd960b tempest-CinderUnicodeTest-1479212601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358" returned: 0 in 0.381s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9ceaf18a-efb6-477f-b90e-f03e05cd960b tempest-CinderUnicodeTest-1479212601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.12e47f9d-1c0f-40fa-b962-b7d093363654 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:04 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:04 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.12e47f9d-1c0f-40fa-b962-b7d093363654 1G Jul 14 13:16:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-64a0d17f-fbf9-4f44-9c52-19d2aa472fb1 tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d" returned: 0 in 0.406s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:04 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-64a0d17f-fbf9-4f44-9c52-19d2aa472fb1 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.5f8e5b30-b9c0-4f78-9b1f-043b302748ed {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:04 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.5f8e5b30-b9c0-4f78-9b1f-043b302748ed Jul 14 13:16:04 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-31f6b9c6-00a3-47e6-9d6e-2c55aaaab918 tempest-ProjectReaderTests-992783010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:05 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-64a0d17f-fbf9-4f44-9c52-19d2aa472fb1 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.5f8e5b30-b9c0-4f78-9b1f-043b302748ed" returned: 0 in 0.347s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-64a0d17f-fbf9-4f44-9c52-19d2aa472fb1 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.5f8e5b30-b9c0-4f78-9b1f-043b302748ed {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:05 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.5f8e5b30-b9c0-4f78-9b1f-043b302748ed Jul 14 13:16:05 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:05 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9ceaf18a-efb6-477f-b90e-f03e05cd960b tempest-CinderUnicodeTest-1479212601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.12e47f9d-1c0f-40fa-b962-b7d093363654 1G" returned: 0 in 0.430s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9ceaf18a-efb6-477f-b90e-f03e05cd960b tempest-CinderUnicodeTest-1479212601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14f832a5-a558-41a1-b3e7-2162600f0358 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.12e47f9d-1c0f-40fa-b962-b7d093363654 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:05 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14f832a5-a558-41a1-b3e7-2162600f0358 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.12e47f9d-1c0f-40fa-b962-b7d093363654 Jul 14 13:16:05 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:05 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-64a0d17f-fbf9-4f44-9c52-19d2aa472fb1 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d.5f8e5b30-b9c0-4f78-9b1f-043b302748ed" returned: 0 in 0.260s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:05 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-64a0d17f-fbf9-4f44-9c52-19d2aa472fb1 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-5f8e5b30-b9c0-4f78-9b1f-043b302748ed" released by "_delete_snapshot" :: held 1.496s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:05 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-64a0d17f-fbf9-4f44-9c52-19d2aa472fb1 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-3c416d0a-c4b1-4a30-8540-08267118b18d" released by "delete_snapshot" :: held 1.519s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:05 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9ceaf18a-efb6-477f-b90e-f03e05cd960b tempest-CinderUnicodeTest-1479212601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14f832a5-a558-41a1-b3e7-2162600f0358 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.12e47f9d-1c0f-40fa-b962-b7d093363654" returned: 0 in 0.300s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:05 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-9ceaf18a-efb6-477f-b90e-f03e05cd960b tempest-CinderUnicodeTest-1479212601 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.12e47f9d-1c0f-40fa-b962-b7d093363654 is being set with open permissions: ugo+rw Jul 14 13:16:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9ceaf18a-efb6-477f-b90e-f03e05cd960b tempest-CinderUnicodeTest-1479212601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.12e47f9d-1c0f-40fa-b962-b7d093363654 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:05 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.12e47f9d-1c0f-40fa-b962-b7d093363654 Jul 14 13:16:05 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:05 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-64a0d17f-fbf9-4f44-9c52-19d2aa472fb1 tempest-ProjectMemberTests-1712779975 None] Created reservations ['16149cb6-e07b-4189-a936-4c471686bd4d', '77bbd3df-eb5f-4082-9d09-7778b9936b1b', 'ca8562ed-3e1a-40a0-afbf-5a4587464b3e', 'acbf82ba-a6ff-4960-a7ef-371402cf6b51'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:05 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-64a0d17f-fbf9-4f44-9c52-19d2aa472fb1 tempest-ProjectMemberTests-1712779975 None] Delete snapshot completed successfully. Jul 14 13:16:05 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-64a0d17f-fbf9-4f44-9c52-19d2aa472fb1 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-5f8e5b30-b9c0-4f78-9b1f-043b302748ed-delete_snapshot" released by "delete_snapshot" :: held 1.678s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:05 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9ceaf18a-efb6-477f-b90e-f03e05cd960b tempest-CinderUnicodeTest-1479212601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.12e47f9d-1c0f-40fa-b962-b7d093363654" returned: 0 in 0.278s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9ceaf18a-efb6-477f-b90e-f03e05cd960b tempest-CinderUnicodeTest-1479212601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:05 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.info Jul 14 13:16:05 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-32c1b0d2-385a-40e9-a5b4-187ff581ff3d tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-3c416d0a-c4b1-4a30-8540-08267118b18d-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:06 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9ceaf18a-efb6-477f-b90e-f03e05cd960b tempest-CinderUnicodeTest-1479212601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.info" returned: 0 in 0.263s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:06 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-9ceaf18a-efb6-477f-b90e-f03e05cd960b tempest-CinderUnicodeTest-1479212601 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.info is being set with open permissions: ugo+rw Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9ceaf18a-efb6-477f-b90e-f03e05cd960b tempest-CinderUnicodeTest-1479212601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-32c1b0d2-385a-40e9-a5b4-187ff581ff3d tempest-ProjectMemberTests-1712779975 None] Lock "cinder-3c416d0a-c4b1-4a30-8540-08267118b18d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:06 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.info Jul 14 13:16:06 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-32c1b0d2-385a-40e9-a5b4-187ff581ff3d tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-3c416d0a-c4b1-4a30-8540-08267118b18d" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-32c1b0d2-385a-40e9-a5b4-187ff581ff3d tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-3c416d0a-c4b1-4a30-8540-08267118b18d" acquired by "delete_volume" :: waited 0.015s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c014415-7fd8-4946-a44c-ae282e74c106]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-32c1b0d2-385a-40e9-a5b4-187ff581ff3d tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:06 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d Jul 14 13:16:06 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:06 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9ceaf18a-efb6-477f-b90e-f03e05cd960b tempest-CinderUnicodeTest-1479212601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.info" returned: 0 in 0.263s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9ceaf18a-efb6-477f-b90e-f03e05cd960b tempest-CinderUnicodeTest-1479212601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.024s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-31f6b9c6-00a3-47e6-9d6e-2c55aaaab918 tempest-ProjectReaderTests-992783010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.496s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-31f6b9c6-00a3-47e6-9d6e-2c55aaaab918 tempest-ProjectReaderTests-992783010 None] Creating offline snapshot a219ee63-89f0-4d20-b973-a00aa99b2c9f of volume 0a5106a2-21c2-440a-89f7-f1d12cd0eb97 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:16:06 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-9ceaf18a-efb6-477f-b90e-f03e05cd960b tempest-CinderUnicodeTest-1479212601 None] Create snapshot completed successfully Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9319242-7bf6-461e-858d-3b2c96e1adbb]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31f6b9c6-00a3-47e6-9d6e-2c55aaaab918 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:06 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97 Jul 14 13:16:06 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:06 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-32c1b0d2-385a-40e9-a5b4-187ff581ff3d tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d" returned: 0 in 0.386s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-32c1b0d2-385a-40e9-a5b4-187ff581ff3d tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:06 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d Jul 14 13:16:06 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:06 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31f6b9c6-00a3-47e6-9d6e-2c55aaaab918 tempest-ProjectReaderTests-992783010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97" returned: 0 in 0.358s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31f6b9c6-00a3-47e6-9d6e-2c55aaaab918 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.a219ee63-89f0-4d20-b973-a00aa99b2c9f 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:06 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.a219ee63-89f0-4d20-b973-a00aa99b2c9f 1G Jul 14 13:16:06 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:06 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-32c1b0d2-385a-40e9-a5b4-187ff581ff3d tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-3c416d0a-c4b1-4a30-8540-08267118b18d" returned: 0 in 0.251s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-32c1b0d2-385a-40e9-a5b4-187ff581ff3d tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-3c416d0a-c4b1-4a30-8540-08267118b18d" released by "delete_volume" :: held 0.693s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-32c1b0d2-385a-40e9-a5b4-187ff581ff3d tempest-ProjectMemberTests-1712779975 None] Created reservations ['8c6d2d16-c995-439f-be8d-2634ad30edd1', 'e08c4bd6-c5e1-4c3d-8138-3fd1cb1eb7bc', '4c0afe5e-8b2a-407a-a387-88fbe32b03c5', '5928665b-bd02-4c36-8cab-2082d96f1c21'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-32c1b0d2-385a-40e9-a5b4-187ff581ff3d tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-32c1b0d2-385a-40e9-a5b4-187ff581ff3d tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-32c1b0d2-385a-40e9-a5b4-187ff581ff3d tempest-ProjectMemberTests-1712779975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-32c1b0d2-385a-40e9-a5b4-187ff581ff3d tempest-ProjectMemberTests-1712779975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-32c1b0d2-385a-40e9-a5b4-187ff581ff3d tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:06 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-32c1b0d2-385a-40e9-a5b4-187ff581ff3d tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:07 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:16:07 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:07 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31f6b9c6-00a3-47e6-9d6e-2c55aaaab918 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.a219ee63-89f0-4d20-b973-a00aa99b2c9f 1G" returned: 0 in 0.422s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31f6b9c6-00a3-47e6-9d6e-2c55aaaab918 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.a219ee63-89f0-4d20-b973-a00aa99b2c9f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:07 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.a219ee63-89f0-4d20-b973-a00aa99b2c9f Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0d3b5533-2e6c-415e-b9fc-679087fb771f tempest-CinderUnicodeTest-1479212601 None] Acquiring lock "cinder-12e47f9d-1c0f-40fa-b962-b7d093363654-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:07 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0d3b5533-2e6c-415e-b9fc-679087fb771f tempest-CinderUnicodeTest-1479212601 None] Lock "cinder-12e47f9d-1c0f-40fa-b962-b7d093363654-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0d3b5533-2e6c-415e-b9fc-679087fb771f tempest-CinderUnicodeTest-1479212601 None] Acquiring lock "cinder-quobyte-14f832a5-a558-41a1-b3e7-2162600f0358" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0d3b5533-2e6c-415e-b9fc-679087fb771f tempest-CinderUnicodeTest-1479212601 None] Lock "cinder-quobyte-14f832a5-a558-41a1-b3e7-2162600f0358" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0d3b5533-2e6c-415e-b9fc-679087fb771f tempest-CinderUnicodeTest-1479212601 None] Acquiring lock "cinder-quobyte-12e47f9d-1c0f-40fa-b962-b7d093363654" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0d3b5533-2e6c-415e-b9fc-679087fb771f tempest-CinderUnicodeTest-1479212601 None] Lock "cinder-quobyte-12e47f9d-1c0f-40fa-b962-b7d093363654" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-0d3b5533-2e6c-415e-b9fc-679087fb771f tempest-CinderUnicodeTest-1479212601 None] Deleting offline snapshot 12e47f9d-1c0f-40fa-b962-b7d093363654 of volume 14f832a5-a558-41a1-b3e7-2162600f0358 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:16:07 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-0d3b5533-2e6c-415e-b9fc-679087fb771f tempest-CinderUnicodeTest-1479212601 None] snapshot_file for this snap is: volume-14f832a5-a558-41a1-b3e7-2162600f0358.12e47f9d-1c0f-40fa-b962-b7d093363654 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-32c1b0d2-385a-40e9-a5b4-187ff581ff3d tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.327s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-32c1b0d2-385a-40e9-a5b4-187ff581ff3d tempest-ProjectMemberTests-1712779975 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6259d69-ce03-431d-8a2a-c907d4a3871b]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0d3b5533-2e6c-415e-b9fc-679087fb771f tempest-CinderUnicodeTest-1479212601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.12e47f9d-1c0f-40fa-b962-b7d093363654 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:07 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-32c1b0d2-385a-40e9-a5b4-187ff581ff3d tempest-ProjectMemberTests-1712779975 None] Deleted volume successfully. Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-32c1b0d2-385a-40e9-a5b4-187ff581ff3d tempest-ProjectMemberTests-1712779975 None] Lock "cinder-3c416d0a-c4b1-4a30-8540-08267118b18d-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:07 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.12e47f9d-1c0f-40fa-b962-b7d093363654 Jul 14 13:16:07 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:07 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31f6b9c6-00a3-47e6-9d6e-2c55aaaab918 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.a219ee63-89f0-4d20-b973-a00aa99b2c9f" returned: 0 in 0.351s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:07 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-31f6b9c6-00a3-47e6-9d6e-2c55aaaab918 tempest-ProjectReaderTests-992783010 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.a219ee63-89f0-4d20-b973-a00aa99b2c9f is being set with open permissions: ugo+rw Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31f6b9c6-00a3-47e6-9d6e-2c55aaaab918 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.a219ee63-89f0-4d20-b973-a00aa99b2c9f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:07 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.a219ee63-89f0-4d20-b973-a00aa99b2c9f Jul 14 13:16:07 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:07 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0d3b5533-2e6c-415e-b9fc-679087fb771f tempest-CinderUnicodeTest-1479212601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.12e47f9d-1c0f-40fa-b962-b7d093363654" returned: 0 in 0.421s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-0d3b5533-2e6c-415e-b9fc-679087fb771f tempest-CinderUnicodeTest-1479212601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14f832a5-a558-41a1-b3e7-2162600f0358(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Flow 'volume_create_manager' (7086f126-5843-484f-beaf-8b87286546bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ca8a40-fc45-422b-9778-392af16ae7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e2762f-4d54-4dcc-b510-7a5634b7c92a]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0d3b5533-2e6c-415e-b9fc-679087fb771f tempest-CinderUnicodeTest-1479212601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:07 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ca8a40-fc45-422b-9778-392af16ae7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-922722932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43a89c2c-2923-41b8-aa33-0befa0d426b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ce77d922d74f64be5aceab89b43e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:16:08Z,use_quota=True,user_id='a8d39912638c4ab594816189250d21e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1686180-4acc-48a7-99c7-fd418e408abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1686180-4acc-48a7-99c7-fd418e408abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241f336c-1a2e-4495-8dbd-9f42ce429af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241f336c-1a2e-4495-8dbd-9f42ce429af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43a89c2c-2923-41b8-aa33-0befa0d426b7', 'volume_name': 'volume-43a89c2c-2923-41b8-aa33-0befa0d426b7', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53719070-2388-42eb-af7b-6246a5f3ca4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53719070-2388-42eb-af7b-6246a5f3ca4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c9c847-4ffb-46ac-bdb0-29df78972be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:07 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Volume 43a89c2c-2923-41b8-aa33-0befa0d426b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43a89c2c-2923-41b8-aa33-0befa0d426b7', 'volume_size': 1} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31f6b9c6-00a3-47e6-9d6e-2c55aaaab918 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.a219ee63-89f0-4d20-b973-a00aa99b2c9f" returned: 0 in 0.335s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:07 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31f6b9c6-00a3-47e6-9d6e-2c55aaaab918 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:07 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.info Jul 14 13:16:07 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:07 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358 Jul 14 13:16:07 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:08 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31f6b9c6-00a3-47e6-9d6e-2c55aaaab918 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.info" returned: 0 in 0.262s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:08 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-31f6b9c6-00a3-47e6-9d6e-2c55aaaab918 tempest-ProjectReaderTests-992783010 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.info is being set with open permissions: ugo+rw Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31f6b9c6-00a3-47e6-9d6e-2c55aaaab918 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:08 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.info Jul 14 13:16:08 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:08 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0d3b5533-2e6c-415e-b9fc-679087fb771f tempest-CinderUnicodeTest-1479212601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358" returned: 0 in 0.379s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0d3b5533-2e6c-415e-b9fc-679087fb771f tempest-CinderUnicodeTest-1479212601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.12e47f9d-1c0f-40fa-b962-b7d093363654 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:08 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.12e47f9d-1c0f-40fa-b962-b7d093363654 Jul 14 13:16:08 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:08 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-31f6b9c6-00a3-47e6-9d6e-2c55aaaab918 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.info" returned: 0 in 0.259s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-31f6b9c6-00a3-47e6-9d6e-2c55aaaab918 tempest-ProjectReaderTests-992783010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.074s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.564s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-922722932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43a89c2c-2923-41b8-aa33-0befa0d426b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ce77d922d74f64be5aceab89b43e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:16:08Z,use_quota=True,user_id='a8d39912638c4ab594816189250d21e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Creating volume 43a89c2c-2923-41b8-aa33-0befa0d426b7 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:16:08 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:08 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7 1073741824 Jul 14 13:16:08 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:08 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-31f6b9c6-00a3-47e6-9d6e-2c55aaaab918 tempest-ProjectReaderTests-992783010 None] Create snapshot completed successfully Jul 14 13:16:08 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0d3b5533-2e6c-415e-b9fc-679087fb771f tempest-CinderUnicodeTest-1479212601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.12e47f9d-1c0f-40fa-b962-b7d093363654" returned: 0 in 0.354s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0d3b5533-2e6c-415e-b9fc-679087fb771f tempest-CinderUnicodeTest-1479212601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.12e47f9d-1c0f-40fa-b962-b7d093363654 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:08 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.12e47f9d-1c0f-40fa-b962-b7d093363654 Jul 14 13:16:08 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:08 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0d3b5533-2e6c-415e-b9fc-679087fb771f tempest-CinderUnicodeTest-1479212601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358.12e47f9d-1c0f-40fa-b962-b7d093363654" returned: 0 in 0.264s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0d3b5533-2e6c-415e-b9fc-679087fb771f tempest-CinderUnicodeTest-1479212601 None] Lock "cinder-quobyte-12e47f9d-1c0f-40fa-b962-b7d093363654" released by "_delete_snapshot" :: held 1.569s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0d3b5533-2e6c-415e-b9fc-679087fb771f tempest-CinderUnicodeTest-1479212601 None] Lock "cinder-quobyte-14f832a5-a558-41a1-b3e7-2162600f0358" released by "delete_snapshot" :: held 1.594s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:08 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7 1073741824" returned: 0 in 0.454s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-0d3b5533-2e6c-415e-b9fc-679087fb771f tempest-CinderUnicodeTest-1479212601 None] Created reservations ['e3a2bc90-ecd8-46ed-9d60-c4e2805b1c1f', '38f03b08-27ba-423d-b5c7-d6c5c0436fa2', 'a69ae8e4-44c6-487d-b5ac-017e1e992a78', '52786084-665b-4601-aa91-db47a6da6ec5'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:08 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:08 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7 Jul 14 13:16:08 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:08 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-0d3b5533-2e6c-415e-b9fc-679087fb771f tempest-CinderUnicodeTest-1479212601 None] Delete snapshot completed successfully. Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0d3b5533-2e6c-415e-b9fc-679087fb771f tempest-CinderUnicodeTest-1479212601 None] Lock "cinder-12e47f9d-1c0f-40fa-b962-b7d093363654-delete_snapshot" released by "delete_snapshot" :: held 1.773s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4e1dbd92-757f-4e4e-bc47-d29b46380b25 tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-a219ee63-89f0-4d20-b973-a00aa99b2c9f-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4e1dbd92-757f-4e4e-bc47-d29b46380b25 tempest-ProjectReaderTests-992783010 None] Lock "cinder-a219ee63-89f0-4d20-b973-a00aa99b2c9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4e1dbd92-757f-4e4e-bc47-d29b46380b25 tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-quobyte-0a5106a2-21c2-440a-89f7-f1d12cd0eb97" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4e1dbd92-757f-4e4e-bc47-d29b46380b25 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-0a5106a2-21c2-440a-89f7-f1d12cd0eb97" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4e1dbd92-757f-4e4e-bc47-d29b46380b25 tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-quobyte-a219ee63-89f0-4d20-b973-a00aa99b2c9f" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4e1dbd92-757f-4e4e-bc47-d29b46380b25 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-a219ee63-89f0-4d20-b973-a00aa99b2c9f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-4e1dbd92-757f-4e4e-bc47-d29b46380b25 tempest-ProjectReaderTests-992783010 None] Deleting offline snapshot a219ee63-89f0-4d20-b973-a00aa99b2c9f of volume 0a5106a2-21c2-440a-89f7-f1d12cd0eb97 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-4e1dbd92-757f-4e4e-bc47-d29b46380b25 tempest-ProjectReaderTests-992783010 None] snapshot_file for this snap is: volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.a219ee63-89f0-4d20-b973-a00aa99b2c9f {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[3918aa23-3a46-49b7-9344-b5799d64cafc]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4e1dbd92-757f-4e4e-bc47-d29b46380b25 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.a219ee63-89f0-4d20-b973-a00aa99b2c9f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:09 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7" returned: 0 in 0.276s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c9c847-4ffb-46ac-bdb0-29df78972be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43a89c2c-2923-41b8-aa33-0befa0d426b7', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1693a6dc-fc6a-400f-8e2c-f235b81fb9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:09 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Volume volume-43a89c2c-2923-41b8-aa33-0befa0d426b7 (43a89c2c-2923-41b8-aa33-0befa0d426b7): created successfully Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1693a6dc-fc6a-400f-8e2c-f235b81fb9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Flow 'volume_create_manager' (7086f126-5843-484f-beaf-8b87286546bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:16:09 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b944ca46-d8b5-44bf-a9d9-bdda4e20dcb3 tempest-ProjectMemberTests-1712779975 None] Created volume successfully. Jul 14 13:16:09 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.a219ee63-89f0-4d20-b973-a00aa99b2c9f Jul 14 13:16:09 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f207b340-2d7c-486e-a286-2d2ac30e5732 tempest-CinderUnicodeTest-1479212601 None] Acquiring lock "cinder-14f832a5-a558-41a1-b3e7-2162600f0358-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f207b340-2d7c-486e-a286-2d2ac30e5732 tempest-CinderUnicodeTest-1479212601 None] Lock "cinder-14f832a5-a558-41a1-b3e7-2162600f0358-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f207b340-2d7c-486e-a286-2d2ac30e5732 tempest-CinderUnicodeTest-1479212601 None] Acquiring lock "cinder-quobyte-14f832a5-a558-41a1-b3e7-2162600f0358" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f207b340-2d7c-486e-a286-2d2ac30e5732 tempest-CinderUnicodeTest-1479212601 None] Lock "cinder-quobyte-14f832a5-a558-41a1-b3e7-2162600f0358" acquired by "delete_volume" :: waited 0.031s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51c296b-d7c4-4740-8106-99d80f441810]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f207b340-2d7c-486e-a286-2d2ac30e5732 tempest-CinderUnicodeTest-1479212601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:09 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4e1dbd92-757f-4e4e-bc47-d29b46380b25 tempest-ProjectReaderTests-992783010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.a219ee63-89f0-4d20-b973-a00aa99b2c9f" returned: 0 in 0.444s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-4e1dbd92-757f-4e4e-bc47-d29b46380b25 tempest-ProjectReaderTests-992783010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e004e24-60c8-4300-b224-ddd8bb056777]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4e1dbd92-757f-4e4e-bc47-d29b46380b25 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:09 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358 Jul 14 13:16:09 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:09 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97 Jul 14 13:16:09 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:09 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f207b340-2d7c-486e-a286-2d2ac30e5732 tempest-CinderUnicodeTest-1479212601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358" returned: 0 in 0.407s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f207b340-2d7c-486e-a286-2d2ac30e5732 tempest-CinderUnicodeTest-1479212601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:09 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358 Jul 14 13:16:09 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c37cf486-aeab-4eea-a4ef-bb2b5a17a037 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c37cf486-aeab-4eea-a4ef-bb2b5a17a037 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-c37cf486-aeab-4eea-a4ef-bb2b5a17a037 tempest-ProjectMemberTests-1712779975 None] Creating offline snapshot dc21270f-ad22-410d-bb96-03f55a37d7d5 of volume 43a89c2c-2923-41b8-aa33-0befa0d426b7 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc419ae6-2c5c-47c5-ab6b-6c84829b62db]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c37cf486-aeab-4eea-a4ef-bb2b5a17a037 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:10 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4e1dbd92-757f-4e4e-bc47-d29b46380b25 tempest-ProjectReaderTests-992783010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97" returned: 0 in 0.428s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4e1dbd92-757f-4e4e-bc47-d29b46380b25 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.a219ee63-89f0-4d20-b973-a00aa99b2c9f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:10 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.a219ee63-89f0-4d20-b973-a00aa99b2c9f Jul 14 13:16:10 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:10 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7 Jul 14 13:16:10 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:10 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f207b340-2d7c-486e-a286-2d2ac30e5732 tempest-CinderUnicodeTest-1479212601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-14f832a5-a558-41a1-b3e7-2162600f0358" returned: 0 in 0.265s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f207b340-2d7c-486e-a286-2d2ac30e5732 tempest-CinderUnicodeTest-1479212601 None] Lock "cinder-quobyte-14f832a5-a558-41a1-b3e7-2162600f0358" released by "delete_volume" :: held 0.731s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-f207b340-2d7c-486e-a286-2d2ac30e5732 tempest-CinderUnicodeTest-1479212601 None] Created reservations ['6120df8e-fec9-46fe-89b8-6650968b07e5', '8c869e3d-eb5d-4c9f-8d44-4e0df99e7a34', '4c3fa25d-4f01-4277-94a0-fd1eb5eba413', 'f46e98bf-d627-4e79-9da3-b70a4233c8d8'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f207b340-2d7c-486e-a286-2d2ac30e5732 tempest-CinderUnicodeTest-1479212601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f207b340-2d7c-486e-a286-2d2ac30e5732 tempest-CinderUnicodeTest-1479212601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f207b340-2d7c-486e-a286-2d2ac30e5732 tempest-CinderUnicodeTest-1479212601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f207b340-2d7c-486e-a286-2d2ac30e5732 tempest-CinderUnicodeTest-1479212601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f207b340-2d7c-486e-a286-2d2ac30e5732 tempest-CinderUnicodeTest-1479212601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f207b340-2d7c-486e-a286-2d2ac30e5732 tempest-CinderUnicodeTest-1479212601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:10 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:16:10 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:10 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4e1dbd92-757f-4e4e-bc47-d29b46380b25 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.a219ee63-89f0-4d20-b973-a00aa99b2c9f" returned: 0 in 0.365s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4e1dbd92-757f-4e4e-bc47-d29b46380b25 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.a219ee63-89f0-4d20-b973-a00aa99b2c9f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:10 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c37cf486-aeab-4eea-a4ef-bb2b5a17a037 tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7" returned: 0 in 0.401s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c37cf486-aeab-4eea-a4ef-bb2b5a17a037 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.dc21270f-ad22-410d-bb96-03f55a37d7d5 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:10 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.a219ee63-89f0-4d20-b973-a00aa99b2c9f Jul 14 13:16:10 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:10 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.dc21270f-ad22-410d-bb96-03f55a37d7d5 1G Jul 14 13:16:10 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-71af3dbf-f9e5-4742-aec1-058deaa18107 tempest-CinderUnicodeTest-1479212601 None] Acquiring lock "cinder-dea2d234-8a35-45d2-97ff-9a2f817c3bfc-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:10 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f207b340-2d7c-486e-a286-2d2ac30e5732 tempest-CinderUnicodeTest-1479212601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.282s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-f207b340-2d7c-486e-a286-2d2ac30e5732 tempest-CinderUnicodeTest-1479212601 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:16:10 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-f207b340-2d7c-486e-a286-2d2ac30e5732 tempest-CinderUnicodeTest-1479212601 None] Deleted volume successfully. Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-71af3dbf-f9e5-4742-aec1-058deaa18107 tempest-CinderUnicodeTest-1479212601 None] Lock "cinder-dea2d234-8a35-45d2-97ff-9a2f817c3bfc-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-f207b340-2d7c-486e-a286-2d2ac30e5732 tempest-CinderUnicodeTest-1479212601 None] Lock "cinder-14f832a5-a558-41a1-b3e7-2162600f0358-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-71af3dbf-f9e5-4742-aec1-058deaa18107 tempest-CinderUnicodeTest-1479212601 None] Acquiring lock "cinder-quobyte-dea2d234-8a35-45d2-97ff-9a2f817c3bfc" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-71af3dbf-f9e5-4742-aec1-058deaa18107 tempest-CinderUnicodeTest-1479212601 None] Lock "cinder-quobyte-dea2d234-8a35-45d2-97ff-9a2f817c3bfc" acquired by "delete_volume" :: waited 0.014s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:10 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4e1dbd92-757f-4e4e-bc47-d29b46380b25 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97.a219ee63-89f0-4d20-b973-a00aa99b2c9f" returned: 0 in 0.323s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7731b4-c8f6-4c47-bb16-68fc0c1daa6e]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71af3dbf-f9e5-4742-aec1-058deaa18107 tempest-CinderUnicodeTest-1479212601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dea2d234-8a35-45d2-97ff-9a2f817c3bfc {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4e1dbd92-757f-4e4e-bc47-d29b46380b25 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-a219ee63-89f0-4d20-b973-a00aa99b2c9f" released by "_delete_snapshot" :: held 1.683s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4e1dbd92-757f-4e4e-bc47-d29b46380b25 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-0a5106a2-21c2-440a-89f7-f1d12cd0eb97" released by "delete_snapshot" :: held 1.709s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-4e1dbd92-757f-4e4e-bc47-d29b46380b25 tempest-ProjectReaderTests-992783010 None] Created reservations ['c810acb7-e1db-4a96-a6bb-80df78178c2a', '7bb1c622-e9db-4b28-b7bb-1786491f3388', '957829dc-6cf0-480e-86bd-7ba963fd2a11', '5e36a110-e4de-4e87-9ac5-12f316db3607'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:10 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:10 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dea2d234-8a35-45d2-97ff-9a2f817c3bfc Jul 14 13:16:10 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c37cf486-aeab-4eea-a4ef-bb2b5a17a037 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.dc21270f-ad22-410d-bb96-03f55a37d7d5 1G" returned: 0 in 0.448s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c37cf486-aeab-4eea-a4ef-bb2b5a17a037 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43a89c2c-2923-41b8-aa33-0befa0d426b7 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.dc21270f-ad22-410d-bb96-03f55a37d7d5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:10 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43a89c2c-2923-41b8-aa33-0befa0d426b7 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.dc21270f-ad22-410d-bb96-03f55a37d7d5 Jul 14 13:16:10 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:10 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-4e1dbd92-757f-4e4e-bc47-d29b46380b25 tempest-ProjectReaderTests-992783010 None] Delete snapshot completed successfully. Jul 14 13:16:10 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4e1dbd92-757f-4e4e-bc47-d29b46380b25 tempest-ProjectReaderTests-992783010 None] Lock "cinder-a219ee63-89f0-4d20-b973-a00aa99b2c9f-delete_snapshot" released by "delete_snapshot" :: held 1.874s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:11 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71af3dbf-f9e5-4742-aec1-058deaa18107 tempest-CinderUnicodeTest-1479212601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dea2d234-8a35-45d2-97ff-9a2f817c3bfc" returned: 0 in 0.360s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71af3dbf-f9e5-4742-aec1-058deaa18107 tempest-CinderUnicodeTest-1479212601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dea2d234-8a35-45d2-97ff-9a2f817c3bfc {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:11 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dea2d234-8a35-45d2-97ff-9a2f817c3bfc Jul 14 13:16:11 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:11 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c37cf486-aeab-4eea-a4ef-bb2b5a17a037 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43a89c2c-2923-41b8-aa33-0befa0d426b7 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.dc21270f-ad22-410d-bb96-03f55a37d7d5" returned: 0 in 0.316s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:11 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-c37cf486-aeab-4eea-a4ef-bb2b5a17a037 tempest-ProjectMemberTests-1712779975 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.dc21270f-ad22-410d-bb96-03f55a37d7d5 is being set with open permissions: ugo+rw Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c37cf486-aeab-4eea-a4ef-bb2b5a17a037 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.dc21270f-ad22-410d-bb96-03f55a37d7d5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:11 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.dc21270f-ad22-410d-bb96-03f55a37d7d5 Jul 14 13:16:11 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-db65245c-a89f-4445-a347-c8d745e0ae72 tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-0a5106a2-21c2-440a-89f7-f1d12cd0eb97-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-db65245c-a89f-4445-a347-c8d745e0ae72 tempest-ProjectReaderTests-992783010 None] Lock "cinder-0a5106a2-21c2-440a-89f7-f1d12cd0eb97-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-db65245c-a89f-4445-a347-c8d745e0ae72 tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-quobyte-0a5106a2-21c2-440a-89f7-f1d12cd0eb97" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-db65245c-a89f-4445-a347-c8d745e0ae72 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-0a5106a2-21c2-440a-89f7-f1d12cd0eb97" acquired by "delete_volume" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a08e266-1c4a-4f0b-a180-a118d126b0d3]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-db65245c-a89f-4445-a347-c8d745e0ae72 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:11 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71af3dbf-f9e5-4742-aec1-058deaa18107 tempest-CinderUnicodeTest-1479212601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-dea2d234-8a35-45d2-97ff-9a2f817c3bfc" returned: 0 in 0.294s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-71af3dbf-f9e5-4742-aec1-058deaa18107 tempest-CinderUnicodeTest-1479212601 None] Lock "cinder-quobyte-dea2d234-8a35-45d2-97ff-9a2f817c3bfc" released by "delete_volume" :: held 0.706s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-71af3dbf-f9e5-4742-aec1-058deaa18107 tempest-CinderUnicodeTest-1479212601 None] Created reservations ['6d2edd9f-fb8e-40e6-9617-5d00a86a058f', '885d630b-5083-4ae7-9dd8-2b0a33fd544f', '2505fa06-d831-446c-aefd-63c30e68fca1', '665deaba-f9ef-4901-9593-3dc1d6f5580a'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:11 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97 Jul 14 13:16:11 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:11 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c37cf486-aeab-4eea-a4ef-bb2b5a17a037 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.dc21270f-ad22-410d-bb96-03f55a37d7d5" returned: 0 in 0.295s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c37cf486-aeab-4eea-a4ef-bb2b5a17a037 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:11 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.info Jul 14 13:16:11 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-71af3dbf-f9e5-4742-aec1-058deaa18107 tempest-CinderUnicodeTest-1479212601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-71af3dbf-f9e5-4742-aec1-058deaa18107 tempest-CinderUnicodeTest-1479212601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-71af3dbf-f9e5-4742-aec1-058deaa18107 tempest-CinderUnicodeTest-1479212601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-71af3dbf-f9e5-4742-aec1-058deaa18107 tempest-CinderUnicodeTest-1479212601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-71af3dbf-f9e5-4742-aec1-058deaa18107 tempest-CinderUnicodeTest-1479212601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71af3dbf-f9e5-4742-aec1-058deaa18107 tempest-CinderUnicodeTest-1479212601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:11 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:16:11 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:11 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-db65245c-a89f-4445-a347-c8d745e0ae72 tempest-ProjectReaderTests-992783010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97" returned: 0 in 0.389s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-db65245c-a89f-4445-a347-c8d745e0ae72 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:11 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97 Jul 14 13:16:11 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:11 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c37cf486-aeab-4eea-a4ef-bb2b5a17a037 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.info" returned: 0 in 0.307s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:11 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-c37cf486-aeab-4eea-a4ef-bb2b5a17a037 tempest-ProjectMemberTests-1712779975 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.info is being set with open permissions: ugo+rw Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c37cf486-aeab-4eea-a4ef-bb2b5a17a037 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:11 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-71af3dbf-f9e5-4742-aec1-058deaa18107 tempest-CinderUnicodeTest-1479212601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.283s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-71af3dbf-f9e5-4742-aec1-058deaa18107 tempest-CinderUnicodeTest-1479212601 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:16:11 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.info Jul 14 13:16:11 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:11 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-71af3dbf-f9e5-4742-aec1-058deaa18107 tempest-CinderUnicodeTest-1479212601 None] Deleted volume successfully. Jul 14 13:16:11 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-71af3dbf-f9e5-4742-aec1-058deaa18107 tempest-CinderUnicodeTest-1479212601 None] Lock "cinder-dea2d234-8a35-45d2-97ff-9a2f817c3bfc-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:12 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-db65245c-a89f-4445-a347-c8d745e0ae72 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-0a5106a2-21c2-440a-89f7-f1d12cd0eb97" returned: 0 in 0.291s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-db65245c-a89f-4445-a347-c8d745e0ae72 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-0a5106a2-21c2-440a-89f7-f1d12cd0eb97" released by "delete_volume" :: held 0.753s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:12 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c37cf486-aeab-4eea-a4ef-bb2b5a17a037 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.info" returned: 0 in 0.255s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c37cf486-aeab-4eea-a4ef-bb2b5a17a037 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.116s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:12 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c37cf486-aeab-4eea-a4ef-bb2b5a17a037 tempest-ProjectMemberTests-1712779975 None] Create snapshot completed successfully Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-db65245c-a89f-4445-a347-c8d745e0ae72 tempest-ProjectReaderTests-992783010 None] Created reservations ['b90c2ad8-28ca-4e62-bb63-e3def5225680', '79e65e8c-0e7e-4627-a8ab-fc84f6ffee6e', '1b6a3930-6941-416b-ae66-4b82b5cc34ea', 'ccbee1dd-7978-40f0-bfb3-d2293ff4f708'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-db65245c-a89f-4445-a347-c8d745e0ae72 tempest-ProjectReaderTests-992783010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-db65245c-a89f-4445-a347-c8d745e0ae72 tempest-ProjectReaderTests-992783010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-db65245c-a89f-4445-a347-c8d745e0ae72 tempest-ProjectReaderTests-992783010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-db65245c-a89f-4445-a347-c8d745e0ae72 tempest-ProjectReaderTests-992783010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-db65245c-a89f-4445-a347-c8d745e0ae72 tempest-ProjectReaderTests-992783010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-db65245c-a89f-4445-a347-c8d745e0ae72 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:12 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:16:12 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:12 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-db65245c-a89f-4445-a347-c8d745e0ae72 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.270s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-db65245c-a89f-4445-a347-c8d745e0ae72 tempest-ProjectReaderTests-992783010 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:16:12 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-db65245c-a89f-4445-a347-c8d745e0ae72 tempest-ProjectReaderTests-992783010 None] Deleted volume successfully. Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-db65245c-a89f-4445-a347-c8d745e0ae72 tempest-ProjectReaderTests-992783010 None] Lock "cinder-0a5106a2-21c2-440a-89f7-f1d12cd0eb97-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Flow 'volume_create_manager' (e7c67cc6-8558-4d3d-a7b0-1582ed841313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d792eee-fdbf-4853-a9db-8528264d7b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d792eee-fdbf-4853-a9db-8528264d7b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-802604013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19db12207814faab3331e1ae1fbcdca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:16:13Z,use_quota=True,user_id='e4d8cf14566c4c4eb638a53175c20e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f52d89-2ab4-41ad-8e19-d4099851ae24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f52d89-2ab4-41ad-8e19-d4099851ae24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e5255a-0015-4f63-a085-3d5260a51baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e5255a-0015-4f63-a085-3d5260a51baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd', 'volume_name': 'volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb73823-260c-473a-85d9-bcac6b82b1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb73823-260c-473a-85d9-bcac6b82b1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c506446-0ba4-4b06-87b6-c10e415dd543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:12 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Volume 8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd', 'volume_size': 1} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-802604013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19db12207814faab3331e1ae1fbcdca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:16:13Z,use_quota=True,user_id='e4d8cf14566c4c4eb638a53175c20e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Creating volume 8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:16:13 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:13 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd 1073741824 Jul 14 13:16:13 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3276ea7f-4d39-49ee-b877-72e3e86c19b6 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-dc21270f-ad22-410d-bb96-03f55a37d7d5-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3276ea7f-4d39-49ee-b877-72e3e86c19b6 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-dc21270f-ad22-410d-bb96-03f55a37d7d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3276ea7f-4d39-49ee-b877-72e3e86c19b6 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-43a89c2c-2923-41b8-aa33-0befa0d426b7" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3276ea7f-4d39-49ee-b877-72e3e86c19b6 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-43a89c2c-2923-41b8-aa33-0befa0d426b7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3276ea7f-4d39-49ee-b877-72e3e86c19b6 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-dc21270f-ad22-410d-bb96-03f55a37d7d5" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3276ea7f-4d39-49ee-b877-72e3e86c19b6 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-dc21270f-ad22-410d-bb96-03f55a37d7d5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-3276ea7f-4d39-49ee-b877-72e3e86c19b6 tempest-ProjectMemberTests-1712779975 None] Deleting offline snapshot dc21270f-ad22-410d-bb96-03f55a37d7d5 of volume 43a89c2c-2923-41b8-aa33-0befa0d426b7 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-3276ea7f-4d39-49ee-b877-72e3e86c19b6 tempest-ProjectMemberTests-1712779975 None] snapshot_file for this snap is: volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.dc21270f-ad22-410d-bb96-03f55a37d7d5 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27fe81e-5a85-499a-a337-1a857bded1df]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3276ea7f-4d39-49ee-b877-72e3e86c19b6 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.dc21270f-ad22-410d-bb96-03f55a37d7d5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:13 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.dc21270f-ad22-410d-bb96-03f55a37d7d5 Jul 14 13:16:13 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:13 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd 1073741824" returned: 0 in 0.518s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:13 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd Jul 14 13:16:13 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:13 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3276ea7f-4d39-49ee-b877-72e3e86c19b6 tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.dc21270f-ad22-410d-bb96-03f55a37d7d5" returned: 0 in 0.391s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-3276ea7f-4d39-49ee-b877-72e3e86c19b6 tempest-ProjectMemberTests-1712779975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43a89c2c-2923-41b8-aa33-0befa0d426b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34eb004-75ed-40f3-a36d-5ffa2c583980]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3276ea7f-4d39-49ee-b877-72e3e86c19b6 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:13 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd" returned: 0 in 0.267s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:13 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7 Jul 14 13:16:13 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c506446-0ba4-4b06-87b6-c10e415dd543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9e0eef-34ea-418c-903d-917095397fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:13 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Volume volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd (8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd): created successfully Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9e0eef-34ea-418c-903d-917095397fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Flow 'volume_create_manager' (e7c67cc6-8558-4d3d-a7b0-1582ed841313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:16:13 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-fc43d86a-5140-4320-b9ad-3539ee0afabb tempest-ProjectReaderTests-992783010 None] Created volume successfully. Jul 14 13:16:14 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3276ea7f-4d39-49ee-b877-72e3e86c19b6 tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7" returned: 0 in 0.358s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3276ea7f-4d39-49ee-b877-72e3e86c19b6 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.dc21270f-ad22-410d-bb96-03f55a37d7d5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:14 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.dc21270f-ad22-410d-bb96-03f55a37d7d5 Jul 14 13:16:14 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:14 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3276ea7f-4d39-49ee-b877-72e3e86c19b6 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.dc21270f-ad22-410d-bb96-03f55a37d7d5" returned: 0 in 0.342s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3276ea7f-4d39-49ee-b877-72e3e86c19b6 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.dc21270f-ad22-410d-bb96-03f55a37d7d5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:14 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.dc21270f-ad22-410d-bb96-03f55a37d7d5 Jul 14 13:16:14 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:14 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3276ea7f-4d39-49ee-b877-72e3e86c19b6 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7.dc21270f-ad22-410d-bb96-03f55a37d7d5" returned: 0 in 0.248s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3276ea7f-4d39-49ee-b877-72e3e86c19b6 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-dc21270f-ad22-410d-bb96-03f55a37d7d5" released by "_delete_snapshot" :: held 1.432s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3276ea7f-4d39-49ee-b877-72e3e86c19b6 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-43a89c2c-2923-41b8-aa33-0befa0d426b7" released by "delete_snapshot" :: held 1.454s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:14 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-3276ea7f-4d39-49ee-b877-72e3e86c19b6 tempest-ProjectMemberTests-1712779975 None] Created reservations ['6cf59170-ab0c-4fd0-8f60-879b0d9dfd95', '8474d30a-afc1-4934-a896-4b7bb7d16fc0', 'ff96bd55-36e5-49ca-9681-703fd1f85331', 'fbb2f77f-5530-4016-aa1e-2a342347541b'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:14 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-3276ea7f-4d39-49ee-b877-72e3e86c19b6 tempest-ProjectMemberTests-1712779975 None] Delete snapshot completed successfully. Jul 14 13:16:14 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3276ea7f-4d39-49ee-b877-72e3e86c19b6 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-dc21270f-ad22-410d-bb96-03f55a37d7d5-delete_snapshot" released by "delete_snapshot" :: held 1.582s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-12a0be2d-ebc0-411c-8a96-6f9a068c837d tempest-ProjectReaderTests-992783010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-12a0be2d-ebc0-411c-8a96-6f9a068c837d tempest-ProjectReaderTests-992783010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:15 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-12a0be2d-ebc0-411c-8a96-6f9a068c837d tempest-ProjectReaderTests-992783010 None] Creating offline snapshot d7f0e247-50a0-488d-964e-67ef996b39af of volume 8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:16:15 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d71f4a-7d27-4764-bd47-fd426b4e9ca7]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-12a0be2d-ebc0-411c-8a96-6f9a068c837d tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:15 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd Jul 14 13:16:15 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6912a88f-9fdd-4711-90aa-2e99f0ffb7e4 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-43a89c2c-2923-41b8-aa33-0befa0d426b7-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6912a88f-9fdd-4711-90aa-2e99f0ffb7e4 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-43a89c2c-2923-41b8-aa33-0befa0d426b7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6912a88f-9fdd-4711-90aa-2e99f0ffb7e4 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-43a89c2c-2923-41b8-aa33-0befa0d426b7" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6912a88f-9fdd-4711-90aa-2e99f0ffb7e4 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-43a89c2c-2923-41b8-aa33-0befa0d426b7" acquired by "delete_volume" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:15 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[8068beb6-1829-4826-9548-758bda3530c5]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6912a88f-9fdd-4711-90aa-2e99f0ffb7e4 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:15 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-12a0be2d-ebc0-411c-8a96-6f9a068c837d tempest-ProjectReaderTests-992783010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd" returned: 0 in 0.376s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-12a0be2d-ebc0-411c-8a96-6f9a068c837d tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.d7f0e247-50a0-488d-964e-67ef996b39af 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:15 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.d7f0e247-50a0-488d-964e-67ef996b39af 1G Jul 14 13:16:15 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:15 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7 Jul 14 13:16:15 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:15 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6912a88f-9fdd-4711-90aa-2e99f0ffb7e4 tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7" returned: 0 in 0.371s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6912a88f-9fdd-4711-90aa-2e99f0ffb7e4 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:15 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7 Jul 14 13:16:15 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:15 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-12a0be2d-ebc0-411c-8a96-6f9a068c837d tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.d7f0e247-50a0-488d-964e-67ef996b39af 1G" returned: 0 in 0.392s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-12a0be2d-ebc0-411c-8a96-6f9a068c837d tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.d7f0e247-50a0-488d-964e-67ef996b39af {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:15 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.d7f0e247-50a0-488d-964e-67ef996b39af Jul 14 13:16:15 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:16 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6912a88f-9fdd-4711-90aa-2e99f0ffb7e4 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-43a89c2c-2923-41b8-aa33-0befa0d426b7" returned: 0 in 0.252s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6912a88f-9fdd-4711-90aa-2e99f0ffb7e4 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-43a89c2c-2923-41b8-aa33-0befa0d426b7" released by "delete_volume" :: held 0.684s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-6912a88f-9fdd-4711-90aa-2e99f0ffb7e4 tempest-ProjectMemberTests-1712779975 None] Created reservations ['54292f3f-b954-42ef-ba21-1ed03e00bcbd', 'e4f813a5-619b-495f-8801-469031750177', '298339a9-aca7-4ee8-a41b-b986ec6574c9', '27a0c0ce-0dea-46ba-aa4a-f26bfb385f15'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6912a88f-9fdd-4711-90aa-2e99f0ffb7e4 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6912a88f-9fdd-4711-90aa-2e99f0ffb7e4 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6912a88f-9fdd-4711-90aa-2e99f0ffb7e4 tempest-ProjectMemberTests-1712779975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6912a88f-9fdd-4711-90aa-2e99f0ffb7e4 tempest-ProjectMemberTests-1712779975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6912a88f-9fdd-4711-90aa-2e99f0ffb7e4 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6912a88f-9fdd-4711-90aa-2e99f0ffb7e4 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:16 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-12a0be2d-ebc0-411c-8a96-6f9a068c837d tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.d7f0e247-50a0-488d-964e-67ef996b39af" returned: 0 in 0.321s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:16 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-12a0be2d-ebc0-411c-8a96-6f9a068c837d tempest-ProjectReaderTests-992783010 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.d7f0e247-50a0-488d-964e-67ef996b39af is being set with open permissions: ugo+rw Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-12a0be2d-ebc0-411c-8a96-6f9a068c837d tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.d7f0e247-50a0-488d-964e-67ef996b39af {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:16 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:16:16 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:16 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.d7f0e247-50a0-488d-964e-67ef996b39af Jul 14 13:16:16 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:16 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6912a88f-9fdd-4711-90aa-2e99f0ffb7e4 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.250s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-6912a88f-9fdd-4711-90aa-2e99f0ffb7e4 tempest-ProjectMemberTests-1712779975 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:16:16 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-6912a88f-9fdd-4711-90aa-2e99f0ffb7e4 tempest-ProjectMemberTests-1712779975 None] Deleted volume successfully. Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6912a88f-9fdd-4711-90aa-2e99f0ffb7e4 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-43a89c2c-2923-41b8-aa33-0befa0d426b7-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:16 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-12a0be2d-ebc0-411c-8a96-6f9a068c837d tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.d7f0e247-50a0-488d-964e-67ef996b39af" returned: 0 in 0.273s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:16 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:16:16 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-12a0be2d-ebc0-411c-8a96-6f9a068c837d tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:16 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.info Jul 14 13:16:16 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:16 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.267s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 29 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 13:16:16 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-12a0be2d-ebc0-411c-8a96-6f9a068c837d tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.info" returned: 0 in 0.295s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:16 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-12a0be2d-ebc0-411c-8a96-6f9a068c837d tempest-ProjectReaderTests-992783010 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.info is being set with open permissions: ugo+rw Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-12a0be2d-ebc0-411c-8a96-6f9a068c837d tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:16 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.info Jul 14 13:16:16 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:16 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Flow 'volume_create_manager' (2608c3f6-ec57-4718-84e0-6b2b35fcd1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87871c06-94f8-4dba-b4c4-ae9c5150ba8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87871c06-94f8-4dba-b4c4-ae9c5150ba8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2032447748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19097e1-a21e-4eef-9a88-592256c945d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ce77d922d74f64be5aceab89b43e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:16:17Z,use_quota=True,user_id='a8d39912638c4ab594816189250d21e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81a763c-1d73-4406-85c6-85072f30f8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81a763c-1d73-4406-85c6-85072f30f8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a730ddf-ff20-463e-abee-7b6651b30916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a730ddf-ff20-463e-abee-7b6651b30916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f19097e1-a21e-4eef-9a88-592256c945d0', 'volume_name': 'volume-f19097e1-a21e-4eef-9a88-592256c945d0', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1371a2eb-ce64-4768-8e25-46f4fbb3c4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1371a2eb-ce64-4768-8e25-46f4fbb3c4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7773f843-9760-4528-abd6-aed98288d465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:17 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Volume f19097e1-a21e-4eef-9a88-592256c945d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f19097e1-a21e-4eef-9a88-592256c945d0', 'volume_size': 1} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:17 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-12a0be2d-ebc0-411c-8a96-6f9a068c837d tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.info" returned: 0 in 0.248s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-12a0be2d-ebc0-411c-8a96-6f9a068c837d tempest-ProjectReaderTests-992783010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.071s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2032447748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19097e1-a21e-4eef-9a88-592256c945d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ce77d922d74f64be5aceab89b43e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:16:17Z,use_quota=True,user_id='a8d39912638c4ab594816189250d21e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Creating volume f19097e1-a21e-4eef-9a88-592256c945d0 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:16:17 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:17 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0 1073741824 Jul 14 13:16:17 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:17 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-12a0be2d-ebc0-411c-8a96-6f9a068c837d tempest-ProjectReaderTests-992783010 None] Create snapshot completed successfully Jul 14 13:16:17 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0 1073741824" returned: 0 in 0.416s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:17 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0 Jul 14 13:16:17 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:17 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0" returned: 0 in 0.249s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7773f843-9760-4528-abd6-aed98288d465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f19097e1-a21e-4eef-9a88-592256c945d0', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfba160-62f0-451d-985f-9e20392114e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:17 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Volume volume-f19097e1-a21e-4eef-9a88-592256c945d0 (f19097e1-a21e-4eef-9a88-592256c945d0): created successfully Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfba160-62f0-451d-985f-9e20392114e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Flow 'volume_create_manager' (2608c3f6-ec57-4718-84e0-6b2b35fcd1f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:16:17 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-8fa3fd1e-b31d-48e8-8e94-861e2eb963fe tempest-ProjectMemberTests-1712779975 None] Created volume successfully. Jul 14 13:16:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-11ef50ad-e0a1-4b23-9725-324b297bc1c2 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-11ef50ad-e0a1-4b23-9725-324b297bc1c2 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-11ef50ad-e0a1-4b23-9725-324b297bc1c2 tempest-ProjectMemberTests-1712779975 None] Creating offline snapshot 433b42b7-c3a5-4009-889a-7e11383afeaf of volume f19097e1-a21e-4eef-9a88-592256c945d0 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:16:18 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f771f2a-fded-4590-a74e-5f65dbf5017c]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11ef50ad-e0a1-4b23-9725-324b297bc1c2 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:18 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0 Jul 14 13:16:18 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-817982d0-8dfe-4d0a-bf0c-de13cedf35e7 tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-d7f0e247-50a0-488d-964e-67ef996b39af-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-817982d0-8dfe-4d0a-bf0c-de13cedf35e7 tempest-ProjectReaderTests-992783010 None] Lock "cinder-d7f0e247-50a0-488d-964e-67ef996b39af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-817982d0-8dfe-4d0a-bf0c-de13cedf35e7 tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-quobyte-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-817982d0-8dfe-4d0a-bf0c-de13cedf35e7 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-817982d0-8dfe-4d0a-bf0c-de13cedf35e7 tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-quobyte-d7f0e247-50a0-488d-964e-67ef996b39af" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-817982d0-8dfe-4d0a-bf0c-de13cedf35e7 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-d7f0e247-50a0-488d-964e-67ef996b39af" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-817982d0-8dfe-4d0a-bf0c-de13cedf35e7 tempest-ProjectReaderTests-992783010 None] Deleting offline snapshot d7f0e247-50a0-488d-964e-67ef996b39af of volume 8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:16:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-817982d0-8dfe-4d0a-bf0c-de13cedf35e7 tempest-ProjectReaderTests-992783010 None] snapshot_file for this snap is: volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.d7f0e247-50a0-488d-964e-67ef996b39af {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:16:18 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a68d3f5-bcfa-4561-86b9-fb3ac21ec79a]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-817982d0-8dfe-4d0a-bf0c-de13cedf35e7 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.d7f0e247-50a0-488d-964e-67ef996b39af {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:18 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.d7f0e247-50a0-488d-964e-67ef996b39af Jul 14 13:16:18 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:18 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11ef50ad-e0a1-4b23-9725-324b297bc1c2 tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0" returned: 0 in 0.382s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11ef50ad-e0a1-4b23-9725-324b297bc1c2 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.433b42b7-c3a5-4009-889a-7e11383afeaf 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:18 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.433b42b7-c3a5-4009-889a-7e11383afeaf 1G Jul 14 13:16:18 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:18 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-817982d0-8dfe-4d0a-bf0c-de13cedf35e7 tempest-ProjectReaderTests-992783010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.d7f0e247-50a0-488d-964e-67ef996b39af" returned: 0 in 0.358s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-817982d0-8dfe-4d0a-bf0c-de13cedf35e7 tempest-ProjectReaderTests-992783010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:16:18 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[babc6ea8-8d82-4e2c-a91b-9edbfa516299]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-817982d0-8dfe-4d0a-bf0c-de13cedf35e7 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:18 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd Jul 14 13:16:18 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:18 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11ef50ad-e0a1-4b23-9725-324b297bc1c2 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.433b42b7-c3a5-4009-889a-7e11383afeaf 1G" returned: 0 in 0.441s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11ef50ad-e0a1-4b23-9725-324b297bc1c2 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f19097e1-a21e-4eef-9a88-592256c945d0 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.433b42b7-c3a5-4009-889a-7e11383afeaf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:19 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f19097e1-a21e-4eef-9a88-592256c945d0 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.433b42b7-c3a5-4009-889a-7e11383afeaf Jul 14 13:16:19 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:19 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-817982d0-8dfe-4d0a-bf0c-de13cedf35e7 tempest-ProjectReaderTests-992783010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd" returned: 0 in 0.399s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-817982d0-8dfe-4d0a-bf0c-de13cedf35e7 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.d7f0e247-50a0-488d-964e-67ef996b39af {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:19 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.d7f0e247-50a0-488d-964e-67ef996b39af Jul 14 13:16:19 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:19 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11ef50ad-e0a1-4b23-9725-324b297bc1c2 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f19097e1-a21e-4eef-9a88-592256c945d0 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.433b42b7-c3a5-4009-889a-7e11383afeaf" returned: 0 in 0.309s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:19 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-11ef50ad-e0a1-4b23-9725-324b297bc1c2 tempest-ProjectMemberTests-1712779975 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.433b42b7-c3a5-4009-889a-7e11383afeaf is being set with open permissions: ugo+rw Jul 14 13:16:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11ef50ad-e0a1-4b23-9725-324b297bc1c2 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.433b42b7-c3a5-4009-889a-7e11383afeaf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:19 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.433b42b7-c3a5-4009-889a-7e11383afeaf Jul 14 13:16:19 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:19 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-817982d0-8dfe-4d0a-bf0c-de13cedf35e7 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.d7f0e247-50a0-488d-964e-67ef996b39af" returned: 0 in 0.321s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-817982d0-8dfe-4d0a-bf0c-de13cedf35e7 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.d7f0e247-50a0-488d-964e-67ef996b39af {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:19 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.d7f0e247-50a0-488d-964e-67ef996b39af Jul 14 13:16:19 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:19 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11ef50ad-e0a1-4b23-9725-324b297bc1c2 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.433b42b7-c3a5-4009-889a-7e11383afeaf" returned: 0 in 0.245s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11ef50ad-e0a1-4b23-9725-324b297bc1c2 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:19 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.info Jul 14 13:16:19 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:19 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-817982d0-8dfe-4d0a-bf0c-de13cedf35e7 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd.d7f0e247-50a0-488d-964e-67ef996b39af" returned: 0 in 0.250s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-817982d0-8dfe-4d0a-bf0c-de13cedf35e7 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-d7f0e247-50a0-488d-964e-67ef996b39af" released by "_delete_snapshot" :: held 1.421s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-817982d0-8dfe-4d0a-bf0c-de13cedf35e7 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd" released by "delete_snapshot" :: held 1.444s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:19 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-817982d0-8dfe-4d0a-bf0c-de13cedf35e7 tempest-ProjectReaderTests-992783010 None] Created reservations ['daad1cc3-607a-41d4-9ed5-bd6c2fad8013', '9cd1f513-e14e-4d52-8a48-c15d7bd55406', '96e68411-9a47-4f1c-b1b3-2c74e5aebb7f', '3e358049-3ff5-4762-b7d8-8f20289db70b'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:19 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11ef50ad-e0a1-4b23-9725-324b297bc1c2 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.info" returned: 0 in 0.267s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:19 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-11ef50ad-e0a1-4b23-9725-324b297bc1c2 tempest-ProjectMemberTests-1712779975 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.info is being set with open permissions: ugo+rw Jul 14 13:16:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11ef50ad-e0a1-4b23-9725-324b297bc1c2 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:19 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.info Jul 14 13:16:19 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:19 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-817982d0-8dfe-4d0a-bf0c-de13cedf35e7 tempest-ProjectReaderTests-992783010 None] Delete snapshot completed successfully. Jul 14 13:16:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-817982d0-8dfe-4d0a-bf0c-de13cedf35e7 tempest-ProjectReaderTests-992783010 None] Lock "cinder-d7f0e247-50a0-488d-964e-67ef996b39af-delete_snapshot" released by "delete_snapshot" :: held 1.595s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:20 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-11ef50ad-e0a1-4b23-9725-324b297bc1c2 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.info" returned: 0 in 0.236s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-11ef50ad-e0a1-4b23-9725-324b297bc1c2 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.991s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:20 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-11ef50ad-e0a1-4b23-9725-324b297bc1c2 tempest-ProjectMemberTests-1712779975 None] Create snapshot completed successfully Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2d51ab9d-2202-4f8d-8ea5-44b8dee7cf16 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-433b42b7-c3a5-4009-889a-7e11383afeaf-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2d51ab9d-2202-4f8d-8ea5-44b8dee7cf16 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-433b42b7-c3a5-4009-889a-7e11383afeaf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2d51ab9d-2202-4f8d-8ea5-44b8dee7cf16 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-f19097e1-a21e-4eef-9a88-592256c945d0" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2d51ab9d-2202-4f8d-8ea5-44b8dee7cf16 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-f19097e1-a21e-4eef-9a88-592256c945d0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2d51ab9d-2202-4f8d-8ea5-44b8dee7cf16 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-433b42b7-c3a5-4009-889a-7e11383afeaf" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2d51ab9d-2202-4f8d-8ea5-44b8dee7cf16 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-433b42b7-c3a5-4009-889a-7e11383afeaf" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-2d51ab9d-2202-4f8d-8ea5-44b8dee7cf16 tempest-ProjectMemberTests-1712779975 None] Deleting offline snapshot 433b42b7-c3a5-4009-889a-7e11383afeaf of volume f19097e1-a21e-4eef-9a88-592256c945d0 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-2d51ab9d-2202-4f8d-8ea5-44b8dee7cf16 tempest-ProjectMemberTests-1712779975 None] snapshot_file for this snap is: volume-f19097e1-a21e-4eef-9a88-592256c945d0.433b42b7-c3a5-4009-889a-7e11383afeaf {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a5301e-b7a8-4b3f-bdc8-b7d4d3b97d6f]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2d51ab9d-2202-4f8d-8ea5-44b8dee7cf16 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.433b42b7-c3a5-4009-889a-7e11383afeaf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-44a7cd38-4807-4b29-890f-eab690514a61 tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:20 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.433b42b7-c3a5-4009-889a-7e11383afeaf Jul 14 13:16:20 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-44a7cd38-4807-4b29-890f-eab690514a61 tempest-ProjectReaderTests-992783010 None] Lock "cinder-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-44a7cd38-4807-4b29-890f-eab690514a61 tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-quobyte-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-44a7cd38-4807-4b29-890f-eab690514a61 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd" acquired by "delete_volume" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[46231a06-a0a0-4e4e-a8cb-4530075b8b74]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-44a7cd38-4807-4b29-890f-eab690514a61 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:20 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd Jul 14 13:16:20 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:20 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2d51ab9d-2202-4f8d-8ea5-44b8dee7cf16 tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.433b42b7-c3a5-4009-889a-7e11383afeaf" returned: 0 in 0.379s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-2d51ab9d-2202-4f8d-8ea5-44b8dee7cf16 tempest-ProjectMemberTests-1712779975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f19097e1-a21e-4eef-9a88-592256c945d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f899dd-8a55-43d1-b117-0001f7812d43]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2d51ab9d-2202-4f8d-8ea5-44b8dee7cf16 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:20 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0 Jul 14 13:16:20 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:20 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-44a7cd38-4807-4b29-890f-eab690514a61 tempest-ProjectReaderTests-992783010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd" returned: 0 in 0.369s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-44a7cd38-4807-4b29-890f-eab690514a61 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:20 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd Jul 14 13:16:20 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:21 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2d51ab9d-2202-4f8d-8ea5-44b8dee7cf16 tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0" returned: 0 in 0.339s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2d51ab9d-2202-4f8d-8ea5-44b8dee7cf16 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.433b42b7-c3a5-4009-889a-7e11383afeaf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:21 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.433b42b7-c3a5-4009-889a-7e11383afeaf Jul 14 13:16:21 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:21 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-44a7cd38-4807-4b29-890f-eab690514a61 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd" returned: 0 in 0.247s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-44a7cd38-4807-4b29-890f-eab690514a61 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd" released by "delete_volume" :: held 0.674s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:21 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-44a7cd38-4807-4b29-890f-eab690514a61 tempest-ProjectReaderTests-992783010 None] Created reservations ['90e78c25-90ec-49b5-9e6c-cb78b8ddf7ce', '0f327f60-e374-4d42-8342-408cad9549c0', '2cff464f-8512-4af4-9758-fa56a83eb8c3', '6667f990-d1b6-45bb-8980-e38015ab5774'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-44a7cd38-4807-4b29-890f-eab690514a61 tempest-ProjectReaderTests-992783010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-44a7cd38-4807-4b29-890f-eab690514a61 tempest-ProjectReaderTests-992783010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-44a7cd38-4807-4b29-890f-eab690514a61 tempest-ProjectReaderTests-992783010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:21 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-44a7cd38-4807-4b29-890f-eab690514a61 tempest-ProjectReaderTests-992783010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-44a7cd38-4807-4b29-890f-eab690514a61 tempest-ProjectReaderTests-992783010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-44a7cd38-4807-4b29-890f-eab690514a61 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:21 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:16:21 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:21 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2d51ab9d-2202-4f8d-8ea5-44b8dee7cf16 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.433b42b7-c3a5-4009-889a-7e11383afeaf" returned: 0 in 0.362s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2d51ab9d-2202-4f8d-8ea5-44b8dee7cf16 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.433b42b7-c3a5-4009-889a-7e11383afeaf {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:21 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.433b42b7-c3a5-4009-889a-7e11383afeaf Jul 14 13:16:21 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:21 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-44a7cd38-4807-4b29-890f-eab690514a61 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.263s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:21 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-44a7cd38-4807-4b29-890f-eab690514a61 tempest-ProjectReaderTests-992783010 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:16:21 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-44a7cd38-4807-4b29-890f-eab690514a61 tempest-ProjectReaderTests-992783010 None] Deleted volume successfully. Jul 14 13:16:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-44a7cd38-4807-4b29-890f-eab690514a61 tempest-ProjectReaderTests-992783010 None] Lock "cinder-8acc6081-442b-4bd6-b36e-e7ad6f0b5bdd-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:21 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:21 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2d51ab9d-2202-4f8d-8ea5-44b8dee7cf16 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0.433b42b7-c3a5-4009-889a-7e11383afeaf" returned: 0 in 0.243s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2d51ab9d-2202-4f8d-8ea5-44b8dee7cf16 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-433b42b7-c3a5-4009-889a-7e11383afeaf" released by "_delete_snapshot" :: held 1.417s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2d51ab9d-2202-4f8d-8ea5-44b8dee7cf16 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-f19097e1-a21e-4eef-9a88-592256c945d0" released by "delete_snapshot" :: held 1.438s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:21 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-2d51ab9d-2202-4f8d-8ea5-44b8dee7cf16 tempest-ProjectMemberTests-1712779975 None] Created reservations ['a9ea56f6-8a58-4e99-bf4a-4c192e3f313c', '821b6e2e-a613-482a-927f-535c16526755', 'dd409125-7837-439d-a081-70368415a5f6', '6d29dee1-3513-42d2-af6c-31517bd77e7c'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:21 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-2d51ab9d-2202-4f8d-8ea5-44b8dee7cf16 tempest-ProjectMemberTests-1712779975 None] Delete snapshot completed successfully. Jul 14 13:16:21 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-2d51ab9d-2202-4f8d-8ea5-44b8dee7cf16 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-433b42b7-c3a5-4009-889a-7e11383afeaf-delete_snapshot" released by "delete_snapshot" :: held 1.610s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Flow 'volume_create_manager' (85136b32-eec7-461d-9655-23b4da35677e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc03ae0d-f855-4de2-84be-5713a973c69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc03ae0d-f855-4de2-84be-5713a973c69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2121760920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dcec21e-4988-4aaa-856d-1642e7746c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19db12207814faab3331e1ae1fbcdca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:16:22Z,use_quota=True,user_id='e4d8cf14566c4c4eb638a53175c20e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16d6c9d-0a9f-44da-b434-64eb710acb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16d6c9d-0a9f-44da-b434-64eb710acb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b2c29e-3229-44ab-a9c4-4131f0616a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b2c29e-3229-44ab-a9c4-4131f0616a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dcec21e-4988-4aaa-856d-1642e7746c55', 'volume_name': 'volume-2dcec21e-4988-4aaa-856d-1642e7746c55', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4e972a-a2be-4a17-b6db-9d6c8ddbcfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4e972a-a2be-4a17-b6db-9d6c8ddbcfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8943e6db-60f1-43aa-9924-f380a905b542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:22 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Volume 2dcec21e-4988-4aaa-856d-1642e7746c55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dcec21e-4988-4aaa-856d-1642e7746c55', 'volume_size': 1} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2121760920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dcec21e-4988-4aaa-856d-1642e7746c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19db12207814faab3331e1ae1fbcdca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:16:22Z,use_quota=True,user_id='e4d8cf14566c4c4eb638a53175c20e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Creating volume 2dcec21e-4988-4aaa-856d-1642e7746c55 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:16:22 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:22 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55 1073741824 Jul 14 13:16:22 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1e39f84-f72b-4a52-9cc3-1c6839b437a0 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-f19097e1-a21e-4eef-9a88-592256c945d0-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1e39f84-f72b-4a52-9cc3-1c6839b437a0 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-f19097e1-a21e-4eef-9a88-592256c945d0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1e39f84-f72b-4a52-9cc3-1c6839b437a0 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-f19097e1-a21e-4eef-9a88-592256c945d0" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1e39f84-f72b-4a52-9cc3-1c6839b437a0 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-f19097e1-a21e-4eef-9a88-592256c945d0" acquired by "delete_volume" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[485631e1-0fcf-4b78-a210-6a120db92de8]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1e39f84-f72b-4a52-9cc3-1c6839b437a0 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:22 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55 1073741824" returned: 0 in 0.467s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:22 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0 Jul 14 13:16:22 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:22 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55 Jul 14 13:16:22 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:22 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1e39f84-f72b-4a52-9cc3-1c6839b437a0 tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0" returned: 0 in 0.365s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1e39f84-f72b-4a52-9cc3-1c6839b437a0 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:22 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0 Jul 14 13:16:22 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:22 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55" returned: 0 in 0.268s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:16:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8943e6db-60f1-43aa-9924-f380a905b542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dcec21e-4988-4aaa-856d-1642e7746c55', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b34c5c2-d6bf-4b85-b6fe-1ccffa76e8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:23 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Volume volume-2dcec21e-4988-4aaa-856d-1642e7746c55 (2dcec21e-4988-4aaa-856d-1642e7746c55): created successfully Jul 14 13:16:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b34c5c2-d6bf-4b85-b6fe-1ccffa76e8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:23 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Flow 'volume_create_manager' (85136b32-eec7-461d-9655-23b4da35677e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:16:23 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-711b4c9b-b79e-4fe3-b45d-ac0b85996a16 tempest-ProjectReaderTests-992783010 None] Created volume successfully. Jul 14 13:16:23 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1e39f84-f72b-4a52-9cc3-1c6839b437a0 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-f19097e1-a21e-4eef-9a88-592256c945d0" returned: 0 in 0.257s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1e39f84-f72b-4a52-9cc3-1c6839b437a0 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-f19097e1-a21e-4eef-9a88-592256c945d0" released by "delete_volume" :: held 0.680s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:23 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-c1e39f84-f72b-4a52-9cc3-1c6839b437a0 tempest-ProjectMemberTests-1712779975 None] Created reservations ['9f073b0d-6af7-4ab3-8bab-fdddbdea6e43', '03262295-0cec-4071-b59c-7cdeb4ed72f2', 'dc090af3-62cc-4052-93dc-34bfc310ffc1', '944d9a41-61f0-4e3d-9861-b3abb1e34621'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c1e39f84-f72b-4a52-9cc3-1c6839b437a0 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c1e39f84-f72b-4a52-9cc3-1c6839b437a0 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c1e39f84-f72b-4a52-9cc3-1c6839b437a0 tempest-ProjectMemberTests-1712779975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-c1e39f84-f72b-4a52-9cc3-1c6839b437a0 tempest-ProjectMemberTests-1712779975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-c1e39f84-f72b-4a52-9cc3-1c6839b437a0 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1e39f84-f72b-4a52-9cc3-1c6839b437a0 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:23 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:16:23 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:23 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-c1e39f84-f72b-4a52-9cc3-1c6839b437a0 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.246s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:23 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-c1e39f84-f72b-4a52-9cc3-1c6839b437a0 tempest-ProjectMemberTests-1712779975 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:16:23 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-c1e39f84-f72b-4a52-9cc3-1c6839b437a0 tempest-ProjectMemberTests-1712779975 None] Deleted volume successfully. Jul 14 13:16:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-c1e39f84-f72b-4a52-9cc3-1c6839b437a0 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-f19097e1-a21e-4eef-9a88-592256c945d0-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Flow 'volume_create_manager' (5fc8ab12-dad6-4b4c-9bc6-d9e1245c00b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f40d4ac-7bc0-467f-9f4a-65a8ff255e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f40d4ac-7bc0-467f-9f4a-65a8ff255e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-91000194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7720862-ca39-4598-a8be-e76fbc4afe4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ce77d922d74f64be5aceab89b43e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:16:24Z,use_quota=True,user_id='a8d39912638c4ab594816189250d21e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16c3ef6-4013-4577-9aaf-dbb7e16c8734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16c3ef6-4013-4577-9aaf-dbb7e16c8734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf51b43-172a-44bc-8d63-023c345203fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf51b43-172a-44bc-8d63-023c345203fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7720862-ca39-4598-a8be-e76fbc4afe4c', 'volume_name': 'volume-c7720862-ca39-4598-a8be-e76fbc4afe4c', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9008178-8df7-414c-a620-349b28b42021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9008178-8df7-414c-a620-349b28b42021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e53bcc0c-4b9c-4228-9c23-da1e4fb986ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:24 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Volume c7720862-ca39-4598-a8be-e76fbc4afe4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7720862-ca39-4598-a8be-e76fbc4afe4c', 'volume_size': 1} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-91000194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7720862-ca39-4598-a8be-e76fbc4afe4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ce77d922d74f64be5aceab89b43e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:16:24Z,use_quota=True,user_id='a8d39912638c4ab594816189250d21e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Creating volume c7720862-ca39-4598-a8be-e76fbc4afe4c {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:16:24 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:24 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c 1073741824 Jul 14 13:16:24 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3c37c320-6188-46c9-bf0b-7b43958200e1 tempest-ProjectReaderTests-992783010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:24 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c 1073741824" returned: 0 in 0.439s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:24 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c Jul 14 13:16:24 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:24 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c" returned: 0 in 0.245s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3c37c320-6188-46c9-bf0b-7b43958200e1 tempest-ProjectReaderTests-992783010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.543s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e53bcc0c-4b9c-4228-9c23-da1e4fb986ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7720862-ca39-4598-a8be-e76fbc4afe4c', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c7b843-b28d-4393-9a1b-ecd9037d0f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-3c37c320-6188-46c9-bf0b-7b43958200e1 tempest-ProjectReaderTests-992783010 None] Creating offline snapshot c699a765-9ce0-4436-aeb8-a6d9e98ac383 of volume 2dcec21e-4988-4aaa-856d-1642e7746c55 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:16:24 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Volume volume-c7720862-ca39-4598-a8be-e76fbc4afe4c (c7720862-ca39-4598-a8be-e76fbc4afe4c): created successfully Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c7b843-b28d-4393-9a1b-ecd9037d0f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Flow 'volume_create_manager' (5fc8ab12-dad6-4b4c-9bc6-d9e1245c00b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[58999bb4-e732-43d5-8eb5-2fbde0271305]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c37c320-6188-46c9-bf0b-7b43958200e1 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:24 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-0514c862-07ed-423e-9a52-075ef8005003 tempest-ProjectMemberTests-1712779975 None] Created volume successfully. Jul 14 13:16:25 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55 Jul 14 13:16:25 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-dcd14cc8-7f5d-4d37-b4a7-68182dcbd779 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:25 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c37c320-6188-46c9-bf0b-7b43958200e1 tempest-ProjectReaderTests-992783010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55" returned: 0 in 0.380s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c37c320-6188-46c9-bf0b-7b43958200e1 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.c699a765-9ce0-4436-aeb8-a6d9e98ac383 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:25 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.c699a765-9ce0-4436-aeb8-a6d9e98ac383 1G Jul 14 13:16:25 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:25 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c37c320-6188-46c9-bf0b-7b43958200e1 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.c699a765-9ce0-4436-aeb8-a6d9e98ac383 1G" returned: 0 in 0.385s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c37c320-6188-46c9-bf0b-7b43958200e1 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dcec21e-4988-4aaa-856d-1642e7746c55 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.c699a765-9ce0-4436-aeb8-a6d9e98ac383 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:25 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dcec21e-4988-4aaa-856d-1642e7746c55 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.c699a765-9ce0-4436-aeb8-a6d9e98ac383 Jul 14 13:16:25 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:25 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c37c320-6188-46c9-bf0b-7b43958200e1 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dcec21e-4988-4aaa-856d-1642e7746c55 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.c699a765-9ce0-4436-aeb8-a6d9e98ac383" returned: 0 in 0.278s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:25 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-3c37c320-6188-46c9-bf0b-7b43958200e1 tempest-ProjectReaderTests-992783010 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.c699a765-9ce0-4436-aeb8-a6d9e98ac383 is being set with open permissions: ugo+rw Jul 14 13:16:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c37c320-6188-46c9-bf0b-7b43958200e1 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.c699a765-9ce0-4436-aeb8-a6d9e98ac383 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:26 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.c699a765-9ce0-4436-aeb8-a6d9e98ac383 Jul 14 13:16:26 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:26 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c37c320-6188-46c9-bf0b-7b43958200e1 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.c699a765-9ce0-4436-aeb8-a6d9e98ac383" returned: 0 in 0.237s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c37c320-6188-46c9-bf0b-7b43958200e1 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:26 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.info Jul 14 13:16:26 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:26 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c37c320-6188-46c9-bf0b-7b43958200e1 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.info" returned: 0 in 0.246s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:26 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-3c37c320-6188-46c9-bf0b-7b43958200e1 tempest-ProjectReaderTests-992783010 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.info is being set with open permissions: ugo+rw Jul 14 13:16:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c37c320-6188-46c9-bf0b-7b43958200e1 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:26 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.info Jul 14 13:16:26 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:26 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3c37c320-6188-46c9-bf0b-7b43958200e1 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.info" returned: 0 in 0.237s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3c37c320-6188-46c9-bf0b-7b43958200e1 tempest-ProjectReaderTests-992783010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.866s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-dcd14cc8-7f5d-4d37-b4a7-68182dcbd779 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.531s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:26 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-dcd14cc8-7f5d-4d37-b4a7-68182dcbd779 tempest-ProjectMemberTests-1712779975 None] Creating offline snapshot fe20968f-c1f6-4c5d-8267-af9c03cedd0c of volume c7720862-ca39-4598-a8be-e76fbc4afe4c {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:16:26 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-3c37c320-6188-46c9-bf0b-7b43958200e1 tempest-ProjectReaderTests-992783010 None] Create snapshot completed successfully Jul 14 13:16:26 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[c155f479-0c74-4b8f-80a7-b9b9c94114c3]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:26 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-dcd14cc8-7f5d-4d37-b4a7-68182dcbd779 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:26 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c Jul 14 13:16:26 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:27 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-dcd14cc8-7f5d-4d37-b4a7-68182dcbd779 tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c" returned: 0 in 0.352s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-dcd14cc8-7f5d-4d37-b4a7-68182dcbd779 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.fe20968f-c1f6-4c5d-8267-af9c03cedd0c 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:27 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.fe20968f-c1f6-4c5d-8267-af9c03cedd0c 1G Jul 14 13:16:27 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d0d93627-171b-45e1-92f7-9147372ada8a tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-c699a765-9ce0-4436-aeb8-a6d9e98ac383-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d0d93627-171b-45e1-92f7-9147372ada8a tempest-ProjectReaderTests-992783010 None] Lock "cinder-c699a765-9ce0-4436-aeb8-a6d9e98ac383-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d0d93627-171b-45e1-92f7-9147372ada8a tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-quobyte-2dcec21e-4988-4aaa-856d-1642e7746c55" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d0d93627-171b-45e1-92f7-9147372ada8a tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-2dcec21e-4988-4aaa-856d-1642e7746c55" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d0d93627-171b-45e1-92f7-9147372ada8a tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-quobyte-c699a765-9ce0-4436-aeb8-a6d9e98ac383" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:27 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d0d93627-171b-45e1-92f7-9147372ada8a tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-c699a765-9ce0-4436-aeb8-a6d9e98ac383" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-d0d93627-171b-45e1-92f7-9147372ada8a tempest-ProjectReaderTests-992783010 None] Deleting offline snapshot c699a765-9ce0-4436-aeb8-a6d9e98ac383 of volume 2dcec21e-4988-4aaa-856d-1642e7746c55 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:16:27 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-d0d93627-171b-45e1-92f7-9147372ada8a tempest-ProjectReaderTests-992783010 None] snapshot_file for this snap is: volume-2dcec21e-4988-4aaa-856d-1642e7746c55.c699a765-9ce0-4436-aeb8-a6d9e98ac383 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:16:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-dcd14cc8-7f5d-4d37-b4a7-68182dcbd779 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.fe20968f-c1f6-4c5d-8267-af9c03cedd0c 1G" returned: 0 in 0.427s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-dcd14cc8-7f5d-4d37-b4a7-68182dcbd779 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7720862-ca39-4598-a8be-e76fbc4afe4c -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.fe20968f-c1f6-4c5d-8267-af9c03cedd0c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:27 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[786357e8-c3f5-4a09-bbae-8df5c376f0de]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d0d93627-171b-45e1-92f7-9147372ada8a tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.c699a765-9ce0-4436-aeb8-a6d9e98ac383 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:27 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7720862-ca39-4598-a8be-e76fbc4afe4c -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.fe20968f-c1f6-4c5d-8267-af9c03cedd0c Jul 14 13:16:27 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:27 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.c699a765-9ce0-4436-aeb8-a6d9e98ac383 Jul 14 13:16:27 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:27 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-dcd14cc8-7f5d-4d37-b4a7-68182dcbd779 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7720862-ca39-4598-a8be-e76fbc4afe4c -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.fe20968f-c1f6-4c5d-8267-af9c03cedd0c" returned: 0 in 0.284s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:27 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-dcd14cc8-7f5d-4d37-b4a7-68182dcbd779 tempest-ProjectMemberTests-1712779975 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.fe20968f-c1f6-4c5d-8267-af9c03cedd0c is being set with open permissions: ugo+rw Jul 14 13:16:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-dcd14cc8-7f5d-4d37-b4a7-68182dcbd779 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.fe20968f-c1f6-4c5d-8267-af9c03cedd0c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:27 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.fe20968f-c1f6-4c5d-8267-af9c03cedd0c Jul 14 13:16:27 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:27 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d0d93627-171b-45e1-92f7-9147372ada8a tempest-ProjectReaderTests-992783010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.c699a765-9ce0-4436-aeb8-a6d9e98ac383" returned: 0 in 0.362s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-d0d93627-171b-45e1-92f7-9147372ada8a tempest-ProjectReaderTests-992783010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2dcec21e-4988-4aaa-856d-1642e7746c55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:16:27 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ee365b-a1c8-4557-8080-0a89f86dace9]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d0d93627-171b-45e1-92f7-9147372ada8a tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:28 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55 Jul 14 13:16:28 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:28 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-dcd14cc8-7f5d-4d37-b4a7-68182dcbd779 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.fe20968f-c1f6-4c5d-8267-af9c03cedd0c" returned: 0 in 0.233s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-dcd14cc8-7f5d-4d37-b4a7-68182dcbd779 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:28 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.info Jul 14 13:16:28 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:28 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d0d93627-171b-45e1-92f7-9147372ada8a tempest-ProjectReaderTests-992783010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55" returned: 0 in 0.384s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d0d93627-171b-45e1-92f7-9147372ada8a tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.c699a765-9ce0-4436-aeb8-a6d9e98ac383 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:28 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-dcd14cc8-7f5d-4d37-b4a7-68182dcbd779 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.info" returned: 0 in 0.259s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:28 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-dcd14cc8-7f5d-4d37-b4a7-68182dcbd779 tempest-ProjectMemberTests-1712779975 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.info is being set with open permissions: ugo+rw Jul 14 13:16:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-dcd14cc8-7f5d-4d37-b4a7-68182dcbd779 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:28 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.c699a765-9ce0-4436-aeb8-a6d9e98ac383 Jul 14 13:16:28 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:28 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.info Jul 14 13:16:28 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:28 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-dcd14cc8-7f5d-4d37-b4a7-68182dcbd779 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.info" returned: 0 in 0.271s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-dcd14cc8-7f5d-4d37-b4a7-68182dcbd779 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.909s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:28 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-dcd14cc8-7f5d-4d37-b4a7-68182dcbd779 tempest-ProjectMemberTests-1712779975 None] Create snapshot completed successfully Jul 14 13:16:28 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d0d93627-171b-45e1-92f7-9147372ada8a tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.c699a765-9ce0-4436-aeb8-a6d9e98ac383" returned: 0 in 0.400s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d0d93627-171b-45e1-92f7-9147372ada8a tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.c699a765-9ce0-4436-aeb8-a6d9e98ac383 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:28 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.c699a765-9ce0-4436-aeb8-a6d9e98ac383 Jul 14 13:16:28 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:29 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-d0d93627-171b-45e1-92f7-9147372ada8a tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55.c699a765-9ce0-4436-aeb8-a6d9e98ac383" returned: 0 in 0.254s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d0d93627-171b-45e1-92f7-9147372ada8a tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-c699a765-9ce0-4436-aeb8-a6d9e98ac383" released by "_delete_snapshot" :: held 1.493s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d0d93627-171b-45e1-92f7-9147372ada8a tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-2dcec21e-4988-4aaa-856d-1642e7746c55" released by "delete_snapshot" :: held 1.513s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-d0d93627-171b-45e1-92f7-9147372ada8a tempest-ProjectReaderTests-992783010 None] Created reservations ['5493834e-7ea2-48f8-a9a9-cc67ca4ab521', '5e619f6f-2ac9-4ea2-a619-eecea6c4ce64', 'ba42fc3b-8980-4ed7-b645-84f445da2c48', '18b7af2a-65c7-4229-a56c-e7be4ffa5abc'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:29 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-d0d93627-171b-45e1-92f7-9147372ada8a tempest-ProjectReaderTests-992783010 None] Delete snapshot completed successfully. Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-d0d93627-171b-45e1-92f7-9147372ada8a tempest-ProjectReaderTests-992783010 None] Lock "cinder-c699a765-9ce0-4436-aeb8-a6d9e98ac383-delete_snapshot" released by "delete_snapshot" :: held 1.643s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-30da032f-ed03-467d-a2c3-d5d3eb7c7dab tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-fe20968f-c1f6-4c5d-8267-af9c03cedd0c-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-30da032f-ed03-467d-a2c3-d5d3eb7c7dab tempest-ProjectMemberTests-1712779975 None] Lock "cinder-fe20968f-c1f6-4c5d-8267-af9c03cedd0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-30da032f-ed03-467d-a2c3-d5d3eb7c7dab tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-c7720862-ca39-4598-a8be-e76fbc4afe4c" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-30da032f-ed03-467d-a2c3-d5d3eb7c7dab tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-c7720862-ca39-4598-a8be-e76fbc4afe4c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-30da032f-ed03-467d-a2c3-d5d3eb7c7dab tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-fe20968f-c1f6-4c5d-8267-af9c03cedd0c" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-30da032f-ed03-467d-a2c3-d5d3eb7c7dab tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-fe20968f-c1f6-4c5d-8267-af9c03cedd0c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-30da032f-ed03-467d-a2c3-d5d3eb7c7dab tempest-ProjectMemberTests-1712779975 None] Deleting offline snapshot fe20968f-c1f6-4c5d-8267-af9c03cedd0c of volume c7720862-ca39-4598-a8be-e76fbc4afe4c {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-30da032f-ed03-467d-a2c3-d5d3eb7c7dab tempest-ProjectMemberTests-1712779975 None] snapshot_file for this snap is: volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.fe20968f-c1f6-4c5d-8267-af9c03cedd0c {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a71e44-0f59-4251-ba05-270ec199bbea]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-30da032f-ed03-467d-a2c3-d5d3eb7c7dab tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.fe20968f-c1f6-4c5d-8267-af9c03cedd0c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:29 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.fe20968f-c1f6-4c5d-8267-af9c03cedd0c Jul 14 13:16:29 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3cef7c82-b31c-42d2-9a39-164beb5b2b07 tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-2dcec21e-4988-4aaa-856d-1642e7746c55-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3cef7c82-b31c-42d2-9a39-164beb5b2b07 tempest-ProjectReaderTests-992783010 None] Lock "cinder-2dcec21e-4988-4aaa-856d-1642e7746c55-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3cef7c82-b31c-42d2-9a39-164beb5b2b07 tempest-ProjectReaderTests-992783010 None] Acquiring lock "cinder-quobyte-2dcec21e-4988-4aaa-856d-1642e7746c55" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3cef7c82-b31c-42d2-9a39-164beb5b2b07 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-2dcec21e-4988-4aaa-856d-1642e7746c55" acquired by "delete_volume" :: waited 0.020s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0959dff-7bd9-42eb-8a8d-61a584d26f3d]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3cef7c82-b31c-42d2-9a39-164beb5b2b07 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:29 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-30da032f-ed03-467d-a2c3-d5d3eb7c7dab tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.fe20968f-c1f6-4c5d-8267-af9c03cedd0c" returned: 0 in 0.383s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-30da032f-ed03-467d-a2c3-d5d3eb7c7dab tempest-ProjectMemberTests-1712779975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7720862-ca39-4598-a8be-e76fbc4afe4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:16:29 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55 Jul 14 13:16:29 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4c251f-ed03-440e-a335-d897dd352de7]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-30da032f-ed03-467d-a2c3-d5d3eb7c7dab tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:30 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c Jul 14 13:16:30 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:30 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3cef7c82-b31c-42d2-9a39-164beb5b2b07 tempest-ProjectReaderTests-992783010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55" returned: 0 in 0.379s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3cef7c82-b31c-42d2-9a39-164beb5b2b07 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:30 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55 Jul 14 13:16:30 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:30 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-30da032f-ed03-467d-a2c3-d5d3eb7c7dab tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c" returned: 0 in 0.361s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-30da032f-ed03-467d-a2c3-d5d3eb7c7dab tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.fe20968f-c1f6-4c5d-8267-af9c03cedd0c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:30 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.fe20968f-c1f6-4c5d-8267-af9c03cedd0c Jul 14 13:16:30 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:30 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3cef7c82-b31c-42d2-9a39-164beb5b2b07 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2dcec21e-4988-4aaa-856d-1642e7746c55" returned: 0 in 0.257s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:30 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3cef7c82-b31c-42d2-9a39-164beb5b2b07 tempest-ProjectReaderTests-992783010 None] Lock "cinder-quobyte-2dcec21e-4988-4aaa-856d-1642e7746c55" released by "delete_volume" :: held 0.699s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:30 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-3cef7c82-b31c-42d2-9a39-164beb5b2b07 tempest-ProjectReaderTests-992783010 None] Created reservations ['59737682-d2ef-4729-918d-e1d4fae0c0ac', 'b96acc3f-ecfc-49e7-a70c-dee238d2ef40', '689e0a8f-c7ff-4c7a-ab31-316a251c6520', '21b7b012-7cf7-44b0-99ef-8fb9b6a2884a'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3cef7c82-b31c-42d2-9a39-164beb5b2b07 tempest-ProjectReaderTests-992783010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3cef7c82-b31c-42d2-9a39-164beb5b2b07 tempest-ProjectReaderTests-992783010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3cef7c82-b31c-42d2-9a39-164beb5b2b07 tempest-ProjectReaderTests-992783010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-3cef7c82-b31c-42d2-9a39-164beb5b2b07 tempest-ProjectReaderTests-992783010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-3cef7c82-b31c-42d2-9a39-164beb5b2b07 tempest-ProjectReaderTests-992783010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3cef7c82-b31c-42d2-9a39-164beb5b2b07 tempest-ProjectReaderTests-992783010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:30 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:16:30 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:30 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-30da032f-ed03-467d-a2c3-d5d3eb7c7dab tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.fe20968f-c1f6-4c5d-8267-af9c03cedd0c" returned: 0 in 0.363s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-30da032f-ed03-467d-a2c3-d5d3eb7c7dab tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.fe20968f-c1f6-4c5d-8267-af9c03cedd0c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:30 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.fe20968f-c1f6-4c5d-8267-af9c03cedd0c Jul 14 13:16:30 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:30 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-3cef7c82-b31c-42d2-9a39-164beb5b2b07 tempest-ProjectReaderTests-992783010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.259s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:30 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-3cef7c82-b31c-42d2-9a39-164beb5b2b07 tempest-ProjectReaderTests-992783010 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:16:30 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-3cef7c82-b31c-42d2-9a39-164beb5b2b07 tempest-ProjectReaderTests-992783010 None] Deleted volume successfully. Jul 14 13:16:30 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-3cef7c82-b31c-42d2-9a39-164beb5b2b07 tempest-ProjectReaderTests-992783010 None] Lock "cinder-2dcec21e-4988-4aaa-856d-1642e7746c55-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:30 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-30da032f-ed03-467d-a2c3-d5d3eb7c7dab tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c.fe20968f-c1f6-4c5d-8267-af9c03cedd0c" returned: 0 in 0.284s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:30 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-30da032f-ed03-467d-a2c3-d5d3eb7c7dab tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-fe20968f-c1f6-4c5d-8267-af9c03cedd0c" released by "_delete_snapshot" :: held 1.481s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:30 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-30da032f-ed03-467d-a2c3-d5d3eb7c7dab tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-c7720862-ca39-4598-a8be-e76fbc4afe4c" released by "delete_snapshot" :: held 1.506s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:31 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-30da032f-ed03-467d-a2c3-d5d3eb7c7dab tempest-ProjectMemberTests-1712779975 None] Created reservations ['e803980e-75e5-47b6-9cc3-ee31cf022cc0', '77ffa2ac-4ccd-4626-bee3-449434c2a052', '6f8a89c9-4665-4046-b3d7-4d90d6eac7d7', 'd559b6c3-df19-4bf0-ad6b-457e532ca33e'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:31 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-30da032f-ed03-467d-a2c3-d5d3eb7c7dab tempest-ProjectMemberTests-1712779975 None] Delete snapshot completed successfully. Jul 14 13:16:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-30da032f-ed03-467d-a2c3-d5d3eb7c7dab tempest-ProjectMemberTests-1712779975 None] Lock "cinder-fe20968f-c1f6-4c5d-8267-af9c03cedd0c-delete_snapshot" released by "delete_snapshot" :: held 1.641s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ec250eae-c17e-4ae7-8eb8-55090042d4fb tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-c7720862-ca39-4598-a8be-e76fbc4afe4c-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ec250eae-c17e-4ae7-8eb8-55090042d4fb tempest-ProjectMemberTests-1712779975 None] Lock "cinder-c7720862-ca39-4598-a8be-e76fbc4afe4c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ec250eae-c17e-4ae7-8eb8-55090042d4fb tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-c7720862-ca39-4598-a8be-e76fbc4afe4c" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:31 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ec250eae-c17e-4ae7-8eb8-55090042d4fb tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-c7720862-ca39-4598-a8be-e76fbc4afe4c" acquired by "delete_volume" :: waited 0.022s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:31 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aab2998-92d6-498e-883a-0c3391acfb7a]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:31 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ec250eae-c17e-4ae7-8eb8-55090042d4fb tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:31 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c Jul 14 13:16:31 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:32 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ec250eae-c17e-4ae7-8eb8-55090042d4fb tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c" returned: 0 in 0.412s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ec250eae-c17e-4ae7-8eb8-55090042d4fb tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:32 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c Jul 14 13:16:32 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:32 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ec250eae-c17e-4ae7-8eb8-55090042d4fb tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c7720862-ca39-4598-a8be-e76fbc4afe4c" returned: 0 in 0.269s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ec250eae-c17e-4ae7-8eb8-55090042d4fb tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-c7720862-ca39-4598-a8be-e76fbc4afe4c" released by "delete_volume" :: held 0.754s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:32 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-ec250eae-c17e-4ae7-8eb8-55090042d4fb tempest-ProjectMemberTests-1712779975 None] Created reservations ['0921a272-0678-499a-94a9-2174b7976f31', 'e8c98138-2f2b-425f-a71b-a16e9cde3e95', 'b744009e-4b30-4202-a952-9af6ce1c53b8', '4121d5d7-a4f4-4533-9985-6e431520eb49'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ec250eae-c17e-4ae7-8eb8-55090042d4fb tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ec250eae-c17e-4ae7-8eb8-55090042d4fb tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:32 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ec250eae-c17e-4ae7-8eb8-55090042d4fb tempest-ProjectMemberTests-1712779975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:32 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ec250eae-c17e-4ae7-8eb8-55090042d4fb tempest-ProjectMemberTests-1712779975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ec250eae-c17e-4ae7-8eb8-55090042d4fb tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ec250eae-c17e-4ae7-8eb8-55090042d4fb tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:32 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:16:32 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:32 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:32 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ec250eae-c17e-4ae7-8eb8-55090042d4fb tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.278s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:32 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-ec250eae-c17e-4ae7-8eb8-55090042d4fb tempest-ProjectMemberTests-1712779975 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:16:32 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-ec250eae-c17e-4ae7-8eb8-55090042d4fb tempest-ProjectMemberTests-1712779975 None] Deleted volume successfully. Jul 14 13:16:32 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ec250eae-c17e-4ae7-8eb8-55090042d4fb tempest-ProjectMemberTests-1712779975 None] Lock "cinder-c7720862-ca39-4598-a8be-e76fbc4afe4c-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Flow 'volume_create_manager' (4fab0ab5-276c-42a5-a6da-44f497865156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef60181-d185-44fc-ad8d-3a3d26ccd5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef60181-d185-44fc-ad8d-3a3d26ccd5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1570421755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e94d55ec-9135-44c8-89b1-9b4bc86bec6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ce77d922d74f64be5aceab89b43e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:16:33Z,use_quota=True,user_id='a8d39912638c4ab594816189250d21e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c1d4eef-4098-4649-997d-0888530d1482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c1d4eef-4098-4649-997d-0888530d1482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88995713-318a-4da1-89fb-82d3938dce3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88995713-318a-4da1-89fb-82d3938dce3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e94d55ec-9135-44c8-89b1-9b4bc86bec6b', 'volume_name': 'volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d65dfcb4-ce56-430d-9437-dacdc0feefe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d65dfcb4-ce56-430d-9437-dacdc0feefe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98617366-0742-4b47-9c2d-aad2e2ed0b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:33 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Volume e94d55ec-9135-44c8-89b1-9b4bc86bec6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b', 'volume_size': 1} Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1570421755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e94d55ec-9135-44c8-89b1-9b4bc86bec6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ce77d922d74f64be5aceab89b43e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:16:33Z,use_quota=True,user_id='a8d39912638c4ab594816189250d21e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Creating volume e94d55ec-9135-44c8-89b1-9b4bc86bec6b {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:16:33 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:33 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b 1073741824 Jul 14 13:16:33 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:33 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b 1073741824" returned: 0 in 0.454s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:33 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:33 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b Jul 14 13:16:33 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:34 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b" returned: 0 in 0.255s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:16:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98617366-0742-4b47-9c2d-aad2e2ed0b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9822fe8-c1ff-4f27-b678-0250b10f92f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:34 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Volume volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b (e94d55ec-9135-44c8-89b1-9b4bc86bec6b): created successfully Jul 14 13:16:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9822fe8-c1ff-4f27-b678-0250b10f92f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:34 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Flow 'volume_create_manager' (4fab0ab5-276c-42a5-a6da-44f497865156) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:16:34 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-aadd8527-80e2-474a-b4c9-5a385c1c9659 tempest-ProjectMemberTests-1712779975 None] Created volume successfully. Jul 14 13:16:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-77678c7c-faf4-4d1b-a7a0-4917932e4e26 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-77678c7c-faf4-4d1b-a7a0-4917932e4e26 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:34 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-77678c7c-faf4-4d1b-a7a0-4917932e4e26 tempest-ProjectMemberTests-1712779975 None] Creating offline snapshot 00e4de62-7a69-4635-bc31-2e1ea4bd024f of volume e94d55ec-9135-44c8-89b1-9b4bc86bec6b {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:16:34 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[64631501-cd9a-4296-aca0-9582c850695a]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-77678c7c-faf4-4d1b-a7a0-4917932e4e26 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:34 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b Jul 14 13:16:34 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:34 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-77678c7c-faf4-4d1b-a7a0-4917932e4e26 tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b" returned: 0 in 0.346s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-77678c7c-faf4-4d1b-a7a0-4917932e4e26 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.00e4de62-7a69-4635-bc31-2e1ea4bd024f 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:34 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.00e4de62-7a69-4635-bc31-2e1ea4bd024f 1G Jul 14 13:16:34 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:35 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-77678c7c-faf4-4d1b-a7a0-4917932e4e26 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.00e4de62-7a69-4635-bc31-2e1ea4bd024f 1G" returned: 0 in 0.384s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-77678c7c-faf4-4d1b-a7a0-4917932e4e26 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.00e4de62-7a69-4635-bc31-2e1ea4bd024f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:35 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.00e4de62-7a69-4635-bc31-2e1ea4bd024f Jul 14 13:16:35 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:35 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-77678c7c-faf4-4d1b-a7a0-4917932e4e26 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.00e4de62-7a69-4635-bc31-2e1ea4bd024f" returned: 0 in 0.321s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:35 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-77678c7c-faf4-4d1b-a7a0-4917932e4e26 tempest-ProjectMemberTests-1712779975 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.00e4de62-7a69-4635-bc31-2e1ea4bd024f is being set with open permissions: ugo+rw Jul 14 13:16:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-77678c7c-faf4-4d1b-a7a0-4917932e4e26 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.00e4de62-7a69-4635-bc31-2e1ea4bd024f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:35 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.00e4de62-7a69-4635-bc31-2e1ea4bd024f Jul 14 13:16:35 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:35 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-77678c7c-faf4-4d1b-a7a0-4917932e4e26 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.00e4de62-7a69-4635-bc31-2e1ea4bd024f" returned: 0 in 0.238s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-77678c7c-faf4-4d1b-a7a0-4917932e4e26 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:35 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.info Jul 14 13:16:35 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:36 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-77678c7c-faf4-4d1b-a7a0-4917932e4e26 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.info" returned: 0 in 0.270s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:36 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-77678c7c-faf4-4d1b-a7a0-4917932e4e26 tempest-ProjectMemberTests-1712779975 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.info is being set with open permissions: ugo+rw Jul 14 13:16:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-77678c7c-faf4-4d1b-a7a0-4917932e4e26 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:36 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.info Jul 14 13:16:36 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:36 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-77678c7c-faf4-4d1b-a7a0-4917932e4e26 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.info" returned: 0 in 0.245s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-77678c7c-faf4-4d1b-a7a0-4917932e4e26 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.878s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:36 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-77678c7c-faf4-4d1b-a7a0-4917932e4e26 tempest-ProjectMemberTests-1712779975 None] Create snapshot completed successfully Jul 14 13:16:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4617d3a9-ca89-4e87-8317-57775c873d6c tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-00e4de62-7a69-4635-bc31-2e1ea4bd024f-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4617d3a9-ca89-4e87-8317-57775c873d6c tempest-ProjectMemberTests-1712779975 None] Lock "cinder-00e4de62-7a69-4635-bc31-2e1ea4bd024f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4617d3a9-ca89-4e87-8317-57775c873d6c tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-e94d55ec-9135-44c8-89b1-9b4bc86bec6b" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4617d3a9-ca89-4e87-8317-57775c873d6c tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-e94d55ec-9135-44c8-89b1-9b4bc86bec6b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4617d3a9-ca89-4e87-8317-57775c873d6c tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-00e4de62-7a69-4635-bc31-2e1ea4bd024f" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4617d3a9-ca89-4e87-8317-57775c873d6c tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-00e4de62-7a69-4635-bc31-2e1ea4bd024f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-4617d3a9-ca89-4e87-8317-57775c873d6c tempest-ProjectMemberTests-1712779975 None] Deleting offline snapshot 00e4de62-7a69-4635-bc31-2e1ea4bd024f of volume e94d55ec-9135-44c8-89b1-9b4bc86bec6b {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:16:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-4617d3a9-ca89-4e87-8317-57775c873d6c tempest-ProjectMemberTests-1712779975 None] snapshot_file for this snap is: volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.00e4de62-7a69-4635-bc31-2e1ea4bd024f {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:16:36 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa88ecb-d17a-4e8c-9a73-565ea68023c0]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4617d3a9-ca89-4e87-8317-57775c873d6c tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.00e4de62-7a69-4635-bc31-2e1ea4bd024f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:36 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.00e4de62-7a69-4635-bc31-2e1ea4bd024f Jul 14 13:16:36 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:37 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4617d3a9-ca89-4e87-8317-57775c873d6c tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.00e4de62-7a69-4635-bc31-2e1ea4bd024f" returned: 0 in 0.357s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:37 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-4617d3a9-ca89-4e87-8317-57775c873d6c tempest-ProjectMemberTests-1712779975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:16:37 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[72350398-5d22-4fd2-b18e-1f2b810e8785]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4617d3a9-ca89-4e87-8317-57775c873d6c tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:37 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b Jul 14 13:16:37 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:37 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4617d3a9-ca89-4e87-8317-57775c873d6c tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b" returned: 0 in 0.383s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4617d3a9-ca89-4e87-8317-57775c873d6c tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.00e4de62-7a69-4635-bc31-2e1ea4bd024f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:37 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.00e4de62-7a69-4635-bc31-2e1ea4bd024f Jul 14 13:16:37 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:37 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4617d3a9-ca89-4e87-8317-57775c873d6c tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.00e4de62-7a69-4635-bc31-2e1ea4bd024f" returned: 0 in 0.412s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4617d3a9-ca89-4e87-8317-57775c873d6c tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.00e4de62-7a69-4635-bc31-2e1ea4bd024f {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:37 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.00e4de62-7a69-4635-bc31-2e1ea4bd024f Jul 14 13:16:37 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:38 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4617d3a9-ca89-4e87-8317-57775c873d6c tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b.00e4de62-7a69-4635-bc31-2e1ea4bd024f" returned: 0 in 0.250s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4617d3a9-ca89-4e87-8317-57775c873d6c tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-00e4de62-7a69-4635-bc31-2e1ea4bd024f" released by "_delete_snapshot" :: held 1.496s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4617d3a9-ca89-4e87-8317-57775c873d6c tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-e94d55ec-9135-44c8-89b1-9b4bc86bec6b" released by "delete_snapshot" :: held 1.517s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:38 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-4617d3a9-ca89-4e87-8317-57775c873d6c tempest-ProjectMemberTests-1712779975 None] Created reservations ['f7223a0a-f06b-4e31-b851-9de6e0b630e0', '9417ef64-1676-4c19-a7b2-f7106fd7fef0', '9f4083fd-f2e6-433a-84b3-f2f6c69882ef', 'f21bbd75-b65d-4fa6-8598-86f6f9ce54f9'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:38 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-4617d3a9-ca89-4e87-8317-57775c873d6c tempest-ProjectMemberTests-1712779975 None] Delete snapshot completed successfully. Jul 14 13:16:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4617d3a9-ca89-4e87-8317-57775c873d6c tempest-ProjectMemberTests-1712779975 None] Lock "cinder-00e4de62-7a69-4635-bc31-2e1ea4bd024f-delete_snapshot" released by "delete_snapshot" :: held 1.645s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-07e95856-3cdc-4533-b00c-987b664fc4a8 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-e94d55ec-9135-44c8-89b1-9b4bc86bec6b-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-07e95856-3cdc-4533-b00c-987b664fc4a8 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-e94d55ec-9135-44c8-89b1-9b4bc86bec6b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-07e95856-3cdc-4533-b00c-987b664fc4a8 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-e94d55ec-9135-44c8-89b1-9b4bc86bec6b" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-07e95856-3cdc-4533-b00c-987b664fc4a8 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-e94d55ec-9135-44c8-89b1-9b4bc86bec6b" acquired by "delete_volume" :: waited 0.023s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:38 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed39df77-f35f-4a6f-861a-43a9e14b4fc1]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-07e95856-3cdc-4533-b00c-987b664fc4a8 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:38 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b Jul 14 13:16:38 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:39 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-07e95856-3cdc-4533-b00c-987b664fc4a8 tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b" returned: 0 in 0.372s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-07e95856-3cdc-4533-b00c-987b664fc4a8 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:39 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b Jul 14 13:16:39 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:39 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-07e95856-3cdc-4533-b00c-987b664fc4a8 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-e94d55ec-9135-44c8-89b1-9b4bc86bec6b" returned: 0 in 0.253s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-07e95856-3cdc-4533-b00c-987b664fc4a8 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-e94d55ec-9135-44c8-89b1-9b4bc86bec6b" released by "delete_volume" :: held 0.684s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:39 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-07e95856-3cdc-4533-b00c-987b664fc4a8 tempest-ProjectMemberTests-1712779975 None] Created reservations ['42d8c643-680e-402b-92eb-002749d6986c', 'ab8832fb-d2da-4f27-9680-f32eb9295386', 'f9f46665-f19e-4a67-bcd2-1cd53b5f0e42', 'a6623a4e-236d-4eb0-9c76-699a4a3b958e'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-07e95856-3cdc-4533-b00c-987b664fc4a8 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-07e95856-3cdc-4533-b00c-987b664fc4a8 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:39 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-07e95856-3cdc-4533-b00c-987b664fc4a8 tempest-ProjectMemberTests-1712779975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:39 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-07e95856-3cdc-4533-b00c-987b664fc4a8 tempest-ProjectMemberTests-1712779975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-07e95856-3cdc-4533-b00c-987b664fc4a8 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-07e95856-3cdc-4533-b00c-987b664fc4a8 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:39 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:16:39 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:39 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-07e95856-3cdc-4533-b00c-987b664fc4a8 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.268s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:39 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-07e95856-3cdc-4533-b00c-987b664fc4a8 tempest-ProjectMemberTests-1712779975 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:16:39 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-07e95856-3cdc-4533-b00c-987b664fc4a8 tempest-ProjectMemberTests-1712779975 None] Deleted volume successfully. Jul 14 13:16:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-07e95856-3cdc-4533-b00c-987b664fc4a8 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-e94d55ec-9135-44c8-89b1-9b4bc86bec6b-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Flow 'volume_create_manager' (59574adb-555f-4cd7-9919-0aeb61bc01d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21926cfb-c0e3-4c48-81b7-f226a6f9d24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21926cfb-c0e3-4c48-81b7-f226a6f9d24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-790692883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0911c05-ebf6-4398-81fe-1e752220afc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ce77d922d74f64be5aceab89b43e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:16:40Z,use_quota=True,user_id='a8d39912638c4ab594816189250d21e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbda8cc-b5e0-4185-88c0-6171f699e34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbda8cc-b5e0-4185-88c0-6171f699e34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe13da09-5338-41c4-b20e-a7d01b1ab09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe13da09-5338-41c4-b20e-a7d01b1ab09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0911c05-ebf6-4398-81fe-1e752220afc3', 'volume_name': 'volume-a0911c05-ebf6-4398-81fe-1e752220afc3', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a03cd28e-294a-4b17-86a8-2bf09163b632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a03cd28e-294a-4b17-86a8-2bf09163b632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3f3a843-d698-4034-8e45-1c07e6e7a680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:40 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Volume a0911c05-ebf6-4398-81fe-1e752220afc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0911c05-ebf6-4398-81fe-1e752220afc3', 'volume_size': 1} Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-790692883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0911c05-ebf6-4398-81fe-1e752220afc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ce77d922d74f64be5aceab89b43e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:16:40Z,use_quota=True,user_id='a8d39912638c4ab594816189250d21e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Creating volume a0911c05-ebf6-4398-81fe-1e752220afc3 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:16:40 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:40 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3 1073741824 Jul 14 13:16:40 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:40 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3 1073741824" returned: 0 in 0.457s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:41 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3 Jul 14 13:16:41 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:41 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3" returned: 0 in 0.247s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:16:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3f3a843-d698-4034-8e45-1c07e6e7a680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0911c05-ebf6-4398-81fe-1e752220afc3', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a93851-9334-421b-a6a7-3aeb77cefd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:41 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Volume volume-a0911c05-ebf6-4398-81fe-1e752220afc3 (a0911c05-ebf6-4398-81fe-1e752220afc3): created successfully Jul 14 13:16:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a93851-9334-421b-a6a7-3aeb77cefd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:41 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Flow 'volume_create_manager' (59574adb-555f-4cd7-9919-0aeb61bc01d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:16:41 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-fa113965-ab68-4e71-8c9c-1195b8495f94 tempest-ProjectMemberTests-1712779975 None] Created volume successfully. Jul 14 13:16:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a1b56b45-ef58-427e-a176-9b2ed655c82d tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a1b56b45-ef58-427e-a176-9b2ed655c82d tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:41 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-a1b56b45-ef58-427e-a176-9b2ed655c82d tempest-ProjectMemberTests-1712779975 None] Creating offline snapshot d2aec103-0992-46e4-9c74-bb005cb36691 of volume a0911c05-ebf6-4398-81fe-1e752220afc3 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:16:41 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b639a6-531c-42a5-8a3a-3fda40e149fd]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:41 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a1b56b45-ef58-427e-a176-9b2ed655c82d tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:41 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3 Jul 14 13:16:41 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:42 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a1b56b45-ef58-427e-a176-9b2ed655c82d tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3" returned: 0 in 0.385s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a1b56b45-ef58-427e-a176-9b2ed655c82d tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.d2aec103-0992-46e4-9c74-bb005cb36691 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:42 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.d2aec103-0992-46e4-9c74-bb005cb36691 1G Jul 14 13:16:42 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:42 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a1b56b45-ef58-427e-a176-9b2ed655c82d tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.d2aec103-0992-46e4-9c74-bb005cb36691 1G" returned: 0 in 0.412s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a1b56b45-ef58-427e-a176-9b2ed655c82d tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0911c05-ebf6-4398-81fe-1e752220afc3 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.d2aec103-0992-46e4-9c74-bb005cb36691 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:42 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0911c05-ebf6-4398-81fe-1e752220afc3 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.d2aec103-0992-46e4-9c74-bb005cb36691 Jul 14 13:16:42 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:42 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a1b56b45-ef58-427e-a176-9b2ed655c82d tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0911c05-ebf6-4398-81fe-1e752220afc3 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.d2aec103-0992-46e4-9c74-bb005cb36691" returned: 0 in 0.305s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:42 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-a1b56b45-ef58-427e-a176-9b2ed655c82d tempest-ProjectMemberTests-1712779975 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.d2aec103-0992-46e4-9c74-bb005cb36691 is being set with open permissions: ugo+rw Jul 14 13:16:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a1b56b45-ef58-427e-a176-9b2ed655c82d tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.d2aec103-0992-46e4-9c74-bb005cb36691 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:42 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.d2aec103-0992-46e4-9c74-bb005cb36691 Jul 14 13:16:42 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:42 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a1b56b45-ef58-427e-a176-9b2ed655c82d tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.d2aec103-0992-46e4-9c74-bb005cb36691" returned: 0 in 0.240s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:42 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a1b56b45-ef58-427e-a176-9b2ed655c82d tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:43 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.info Jul 14 13:16:43 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:43 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a1b56b45-ef58-427e-a176-9b2ed655c82d tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.info" returned: 0 in 0.242s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:43 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-a1b56b45-ef58-427e-a176-9b2ed655c82d tempest-ProjectMemberTests-1712779975 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.info is being set with open permissions: ugo+rw Jul 14 13:16:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a1b56b45-ef58-427e-a176-9b2ed655c82d tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:43 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.info Jul 14 13:16:43 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:43 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-a1b56b45-ef58-427e-a176-9b2ed655c82d tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.info" returned: 0 in 0.240s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-a1b56b45-ef58-427e-a176-9b2ed655c82d tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.908s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:43 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-a1b56b45-ef58-427e-a176-9b2ed655c82d tempest-ProjectMemberTests-1712779975 None] Create snapshot completed successfully Jul 14 13:16:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ba27cb0c-6e96-4236-8e01-cbd8565bc7ec tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-d2aec103-0992-46e4-9c74-bb005cb36691-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ba27cb0c-6e96-4236-8e01-cbd8565bc7ec tempest-ProjectMemberTests-1712779975 None] Lock "cinder-d2aec103-0992-46e4-9c74-bb005cb36691-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ba27cb0c-6e96-4236-8e01-cbd8565bc7ec tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-a0911c05-ebf6-4398-81fe-1e752220afc3" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ba27cb0c-6e96-4236-8e01-cbd8565bc7ec tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-a0911c05-ebf6-4398-81fe-1e752220afc3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ba27cb0c-6e96-4236-8e01-cbd8565bc7ec tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-d2aec103-0992-46e4-9c74-bb005cb36691" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:43 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ba27cb0c-6e96-4236-8e01-cbd8565bc7ec tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-d2aec103-0992-46e4-9c74-bb005cb36691" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:43 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-ba27cb0c-6e96-4236-8e01-cbd8565bc7ec tempest-ProjectMemberTests-1712779975 None] Deleting offline snapshot d2aec103-0992-46e4-9c74-bb005cb36691 of volume a0911c05-ebf6-4398-81fe-1e752220afc3 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:16:43 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-ba27cb0c-6e96-4236-8e01-cbd8565bc7ec tempest-ProjectMemberTests-1712779975 None] snapshot_file for this snap is: volume-a0911c05-ebf6-4398-81fe-1e752220afc3.d2aec103-0992-46e4-9c74-bb005cb36691 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:16:43 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ef0f80-39b7-4e6e-8aef-5e956b27c2da]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:43 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ba27cb0c-6e96-4236-8e01-cbd8565bc7ec tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.d2aec103-0992-46e4-9c74-bb005cb36691 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:43 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.d2aec103-0992-46e4-9c74-bb005cb36691 Jul 14 13:16:43 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:44 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ba27cb0c-6e96-4236-8e01-cbd8565bc7ec tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.d2aec103-0992-46e4-9c74-bb005cb36691" returned: 0 in 0.367s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:44 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-ba27cb0c-6e96-4236-8e01-cbd8565bc7ec tempest-ProjectMemberTests-1712779975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0911c05-ebf6-4398-81fe-1e752220afc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:16:44 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc770a9e-aec4-47c1-8fbe-2034fc48df15]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ba27cb0c-6e96-4236-8e01-cbd8565bc7ec tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:44 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3 Jul 14 13:16:44 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:44 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ba27cb0c-6e96-4236-8e01-cbd8565bc7ec tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3" returned: 0 in 0.370s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ba27cb0c-6e96-4236-8e01-cbd8565bc7ec tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.d2aec103-0992-46e4-9c74-bb005cb36691 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:44 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.d2aec103-0992-46e4-9c74-bb005cb36691 Jul 14 13:16:44 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:44 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ba27cb0c-6e96-4236-8e01-cbd8565bc7ec tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.d2aec103-0992-46e4-9c74-bb005cb36691" returned: 0 in 0.328s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:44 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ba27cb0c-6e96-4236-8e01-cbd8565bc7ec tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.d2aec103-0992-46e4-9c74-bb005cb36691 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:44 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.d2aec103-0992-46e4-9c74-bb005cb36691 Jul 14 13:16:44 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:45 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:45 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ba27cb0c-6e96-4236-8e01-cbd8565bc7ec tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3.d2aec103-0992-46e4-9c74-bb005cb36691" returned: 0 in 0.248s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ba27cb0c-6e96-4236-8e01-cbd8565bc7ec tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-d2aec103-0992-46e4-9c74-bb005cb36691" released by "_delete_snapshot" :: held 1.411s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ba27cb0c-6e96-4236-8e01-cbd8565bc7ec tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-a0911c05-ebf6-4398-81fe-1e752220afc3" released by "delete_snapshot" :: held 1.438s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:45 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-ba27cb0c-6e96-4236-8e01-cbd8565bc7ec tempest-ProjectMemberTests-1712779975 None] Created reservations ['dae70f5e-a066-4a58-8bdf-c9f465cb9a35', 'c3315a4b-fac5-4f0c-a816-5756fae3bfef', 'a0462704-3a98-4e5d-bf96-cf878e514db5', '1d1d4569-8a3e-4c9a-bec5-5ec1490dac28'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:45 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-ba27cb0c-6e96-4236-8e01-cbd8565bc7ec tempest-ProjectMemberTests-1712779975 None] Delete snapshot completed successfully. Jul 14 13:16:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ba27cb0c-6e96-4236-8e01-cbd8565bc7ec tempest-ProjectMemberTests-1712779975 None] Lock "cinder-d2aec103-0992-46e4-9c74-bb005cb36691-delete_snapshot" released by "delete_snapshot" :: held 1.577s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-39cadbae-69fa-410a-bd55-701db1c9791e tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-a0911c05-ebf6-4398-81fe-1e752220afc3-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-39cadbae-69fa-410a-bd55-701db1c9791e tempest-ProjectMemberTests-1712779975 None] Lock "cinder-a0911c05-ebf6-4398-81fe-1e752220afc3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-39cadbae-69fa-410a-bd55-701db1c9791e tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-a0911c05-ebf6-4398-81fe-1e752220afc3" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:45 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-39cadbae-69fa-410a-bd55-701db1c9791e tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-a0911c05-ebf6-4398-81fe-1e752220afc3" acquired by "delete_volume" :: waited 0.020s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:46 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c723dcb-b35e-4395-9e33-65d13982e669]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-39cadbae-69fa-410a-bd55-701db1c9791e tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:46 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3 Jul 14 13:16:46 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:46 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-39cadbae-69fa-410a-bd55-701db1c9791e tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3" returned: 0 in 0.373s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-39cadbae-69fa-410a-bd55-701db1c9791e tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:46 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3 Jul 14 13:16:46 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:46 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-39cadbae-69fa-410a-bd55-701db1c9791e tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-a0911c05-ebf6-4398-81fe-1e752220afc3" returned: 0 in 0.252s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:46 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-39cadbae-69fa-410a-bd55-701db1c9791e tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-a0911c05-ebf6-4398-81fe-1e752220afc3" released by "delete_volume" :: held 0.684s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:46 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-39cadbae-69fa-410a-bd55-701db1c9791e tempest-ProjectMemberTests-1712779975 None] Created reservations ['b0dd594f-a7a9-490b-8eca-0a9b48978417', '20efbca7-c877-497d-a5fa-725954cc581a', '1cd44b09-c011-472a-a406-687058bc9884', '6894d9d6-dd6d-4256-afe9-b11da1ea84bc'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-39cadbae-69fa-410a-bd55-701db1c9791e tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-39cadbae-69fa-410a-bd55-701db1c9791e tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:46 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-39cadbae-69fa-410a-bd55-701db1c9791e tempest-ProjectMemberTests-1712779975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:46 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-39cadbae-69fa-410a-bd55-701db1c9791e tempest-ProjectMemberTests-1712779975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-39cadbae-69fa-410a-bd55-701db1c9791e tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:46 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-39cadbae-69fa-410a-bd55-701db1c9791e tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:46 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:16:46 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:47 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-39cadbae-69fa-410a-bd55-701db1c9791e tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.257s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-39cadbae-69fa-410a-bd55-701db1c9791e tempest-ProjectMemberTests-1712779975 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:16:47 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-39cadbae-69fa-410a-bd55-701db1c9791e tempest-ProjectMemberTests-1712779975 None] Deleted volume successfully. Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-39cadbae-69fa-410a-bd55-701db1c9791e tempest-ProjectMemberTests-1712779975 None] Lock "cinder-a0911c05-ebf6-4398-81fe-1e752220afc3-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Flow 'volume_create_manager' (54f8a242-ed79-4ec5-9900-ece1aafbe27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01170bc6-42c9-4136-b57d-b03d21e741b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01170bc6-42c9-4136-b57d-b03d21e741b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1056900351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f935005-92cd-4841-a7b6-25bb5eb58edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ce77d922d74f64be5aceab89b43e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:16:47Z,use_quota=True,user_id='a8d39912638c4ab594816189250d21e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501182ad-89e4-405b-acc1-995815639b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501182ad-89e4-405b-acc1-995815639b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4866f1b0-053b-4fa9-84b4-1a090013deb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4866f1b0-053b-4fa9-84b4-1a090013deb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f935005-92cd-4841-a7b6-25bb5eb58edc', 'volume_name': 'volume-1f935005-92cd-4841-a7b6-25bb5eb58edc', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (864a6f6b-b92a-4af5-aa5d-e912d40b5d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (864a6f6b-b92a-4af5-aa5d-e912d40b5d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7ceda3-c628-429d-8f58-91f1b0d19980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:47 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Volume 1f935005-92cd-4841-a7b6-25bb5eb58edc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f935005-92cd-4841-a7b6-25bb5eb58edc', 'volume_size': 1} Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1056900351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f935005-92cd-4841-a7b6-25bb5eb58edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ce77d922d74f64be5aceab89b43e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:16:47Z,use_quota=True,user_id='a8d39912638c4ab594816189250d21e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Creating volume 1f935005-92cd-4841-a7b6-25bb5eb58edc {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:16:47 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:16:47 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:47 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc 1073741824 Jul 14 13:16:47 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:48 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc 1073741824" returned: 0 in 0.450s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:48 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc Jul 14 13:16:48 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:48 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc" returned: 0 in 0.266s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:48 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:16:48 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:48 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7ceda3-c628-429d-8f58-91f1b0d19980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f935005-92cd-4841-a7b6-25bb5eb58edc', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:48 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05c1ff7-56ed-4fa7-82df-149bb405d982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:48 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Volume volume-1f935005-92cd-4841-a7b6-25bb5eb58edc (1f935005-92cd-4841-a7b6-25bb5eb58edc): created successfully Jul 14 13:16:48 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05c1ff7-56ed-4fa7-82df-149bb405d982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:48 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Flow 'volume_create_manager' (54f8a242-ed79-4ec5-9900-ece1aafbe27a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:16:48 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e9d82554-d91f-4a43-9467-84c49818ec99 tempest-ProjectMemberTests-1712779975 None] Created volume successfully. Jul 14 13:16:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-39893f11-7214-4f65-8f52-988b25f8a817 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-39893f11-7214-4f65-8f52-988b25f8a817 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:49 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-39893f11-7214-4f65-8f52-988b25f8a817 tempest-ProjectMemberTests-1712779975 None] Creating offline snapshot 093e58c3-2a19-4b80-953f-cff16e9e1bfe of volume 1f935005-92cd-4841-a7b6-25bb5eb58edc {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:16:49 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[6387167e-0e49-4629-90f1-1500af1fe8a3]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:49 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-39893f11-7214-4f65-8f52-988b25f8a817 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:49 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc Jul 14 13:16:49 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:50 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-39893f11-7214-4f65-8f52-988b25f8a817 tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc" returned: 0 in 0.394s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-39893f11-7214-4f65-8f52-988b25f8a817 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.093e58c3-2a19-4b80-953f-cff16e9e1bfe 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:50 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.093e58c3-2a19-4b80-953f-cff16e9e1bfe 1G Jul 14 13:16:50 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:50 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-39893f11-7214-4f65-8f52-988b25f8a817 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.093e58c3-2a19-4b80-953f-cff16e9e1bfe 1G" returned: 0 in 0.414s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-39893f11-7214-4f65-8f52-988b25f8a817 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f935005-92cd-4841-a7b6-25bb5eb58edc -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.093e58c3-2a19-4b80-953f-cff16e9e1bfe {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:50 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f935005-92cd-4841-a7b6-25bb5eb58edc -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.093e58c3-2a19-4b80-953f-cff16e9e1bfe Jul 14 13:16:50 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:50 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-39893f11-7214-4f65-8f52-988b25f8a817 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f935005-92cd-4841-a7b6-25bb5eb58edc -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.093e58c3-2a19-4b80-953f-cff16e9e1bfe" returned: 0 in 0.290s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:50 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-39893f11-7214-4f65-8f52-988b25f8a817 tempest-ProjectMemberTests-1712779975 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.093e58c3-2a19-4b80-953f-cff16e9e1bfe is being set with open permissions: ugo+rw Jul 14 13:16:50 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-39893f11-7214-4f65-8f52-988b25f8a817 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.093e58c3-2a19-4b80-953f-cff16e9e1bfe {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:50 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.093e58c3-2a19-4b80-953f-cff16e9e1bfe Jul 14 13:16:50 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:51 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-39893f11-7214-4f65-8f52-988b25f8a817 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.093e58c3-2a19-4b80-953f-cff16e9e1bfe" returned: 0 in 0.236s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-39893f11-7214-4f65-8f52-988b25f8a817 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:51 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.info Jul 14 13:16:51 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:51 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-39893f11-7214-4f65-8f52-988b25f8a817 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.info" returned: 0 in 0.266s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:51 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-39893f11-7214-4f65-8f52-988b25f8a817 tempest-ProjectMemberTests-1712779975 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.info is being set with open permissions: ugo+rw Jul 14 13:16:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-39893f11-7214-4f65-8f52-988b25f8a817 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:51 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.info Jul 14 13:16:51 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:51 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-39893f11-7214-4f65-8f52-988b25f8a817 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.info" returned: 0 in 0.251s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:51 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-39893f11-7214-4f65-8f52-988b25f8a817 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:51 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-39893f11-7214-4f65-8f52-988b25f8a817 tempest-ProjectMemberTests-1712779975 None] Create snapshot completed successfully Jul 14 13:16:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6964f5fa-a14d-4790-b61b-0ac18964dfb7 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-093e58c3-2a19-4b80-953f-cff16e9e1bfe-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6964f5fa-a14d-4790-b61b-0ac18964dfb7 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-093e58c3-2a19-4b80-953f-cff16e9e1bfe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6964f5fa-a14d-4790-b61b-0ac18964dfb7 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-1f935005-92cd-4841-a7b6-25bb5eb58edc" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6964f5fa-a14d-4790-b61b-0ac18964dfb7 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-1f935005-92cd-4841-a7b6-25bb5eb58edc" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:51 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6964f5fa-a14d-4790-b61b-0ac18964dfb7 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-093e58c3-2a19-4b80-953f-cff16e9e1bfe" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:52 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6964f5fa-a14d-4790-b61b-0ac18964dfb7 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-093e58c3-2a19-4b80-953f-cff16e9e1bfe" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-6964f5fa-a14d-4790-b61b-0ac18964dfb7 tempest-ProjectMemberTests-1712779975 None] Deleting offline snapshot 093e58c3-2a19-4b80-953f-cff16e9e1bfe of volume 1f935005-92cd-4841-a7b6-25bb5eb58edc {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:16:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-6964f5fa-a14d-4790-b61b-0ac18964dfb7 tempest-ProjectMemberTests-1712779975 None] snapshot_file for this snap is: volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.093e58c3-2a19-4b80-953f-cff16e9e1bfe {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:16:52 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e3ead9-0495-4fed-ad81-3f7e91024e96]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6964f5fa-a14d-4790-b61b-0ac18964dfb7 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.093e58c3-2a19-4b80-953f-cff16e9e1bfe {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:52 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.093e58c3-2a19-4b80-953f-cff16e9e1bfe Jul 14 13:16:52 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:52 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6964f5fa-a14d-4790-b61b-0ac18964dfb7 tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.093e58c3-2a19-4b80-953f-cff16e9e1bfe" returned: 0 in 0.362s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:52 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-6964f5fa-a14d-4790-b61b-0ac18964dfb7 tempest-ProjectMemberTests-1712779975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f935005-92cd-4841-a7b6-25bb5eb58edc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:16:52 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d1ba1b-8859-46e8-82fa-6ab176ae249d]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6964f5fa-a14d-4790-b61b-0ac18964dfb7 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:52 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc Jul 14 13:16:52 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:52 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6964f5fa-a14d-4790-b61b-0ac18964dfb7 tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc" returned: 0 in 0.376s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:52 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6964f5fa-a14d-4790-b61b-0ac18964dfb7 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.093e58c3-2a19-4b80-953f-cff16e9e1bfe {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:52 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.093e58c3-2a19-4b80-953f-cff16e9e1bfe Jul 14 13:16:52 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:53 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6964f5fa-a14d-4790-b61b-0ac18964dfb7 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.093e58c3-2a19-4b80-953f-cff16e9e1bfe" returned: 0 in 0.352s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6964f5fa-a14d-4790-b61b-0ac18964dfb7 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.093e58c3-2a19-4b80-953f-cff16e9e1bfe {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:53 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.093e58c3-2a19-4b80-953f-cff16e9e1bfe Jul 14 13:16:53 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:53 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:53 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6964f5fa-a14d-4790-b61b-0ac18964dfb7 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc.093e58c3-2a19-4b80-953f-cff16e9e1bfe" returned: 0 in 0.261s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:53 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6964f5fa-a14d-4790-b61b-0ac18964dfb7 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-093e58c3-2a19-4b80-953f-cff16e9e1bfe" released by "_delete_snapshot" :: held 1.450s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:53 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6964f5fa-a14d-4790-b61b-0ac18964dfb7 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-1f935005-92cd-4841-a7b6-25bb5eb58edc" released by "delete_snapshot" :: held 1.471s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:53 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-6964f5fa-a14d-4790-b61b-0ac18964dfb7 tempest-ProjectMemberTests-1712779975 None] Created reservations ['2797e179-5a97-4a89-b506-7e38264ee0e0', 'c15a6c54-c460-44d2-8d4c-2a118fab68f2', '15a392d9-fb32-4f76-874d-8326d79ea0b9', '3857a9c0-4330-4dfe-a2cd-b28b67f91d51'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:53 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-6964f5fa-a14d-4790-b61b-0ac18964dfb7 tempest-ProjectMemberTests-1712779975 None] Delete snapshot completed successfully. Jul 14 13:16:53 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6964f5fa-a14d-4790-b61b-0ac18964dfb7 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-093e58c3-2a19-4b80-953f-cff16e9e1bfe-delete_snapshot" released by "delete_snapshot" :: held 1.597s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:54 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0b864bf3-940d-4c17-b5ac-f597647282e5 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-1f935005-92cd-4841-a7b6-25bb5eb58edc-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:54 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0b864bf3-940d-4c17-b5ac-f597647282e5 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-1f935005-92cd-4841-a7b6-25bb5eb58edc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:54 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0b864bf3-940d-4c17-b5ac-f597647282e5 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "cinder-quobyte-1f935005-92cd-4841-a7b6-25bb5eb58edc" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:16:54 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0b864bf3-940d-4c17-b5ac-f597647282e5 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-1f935005-92cd-4841-a7b6-25bb5eb58edc" acquired by "delete_volume" :: waited 0.014s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:16:54 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[342d3a6f-1ccd-4b9f-a6b2-87d395cad3e5]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:16:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0b864bf3-940d-4c17-b5ac-f597647282e5 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:54 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc Jul 14 13:16:54 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:54 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0b864bf3-940d-4c17-b5ac-f597647282e5 tempest-ProjectMemberTests-1712779975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc" returned: 0 in 0.375s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0b864bf3-940d-4c17-b5ac-f597647282e5 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:54 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc Jul 14 13:16:54 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:54 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:54 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0b864bf3-940d-4c17-b5ac-f597647282e5 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-1f935005-92cd-4841-a7b6-25bb5eb58edc" returned: 0 in 0.261s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:54 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0b864bf3-940d-4c17-b5ac-f597647282e5 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-quobyte-1f935005-92cd-4841-a7b6-25bb5eb58edc" released by "delete_volume" :: held 0.694s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:54 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-0b864bf3-940d-4c17-b5ac-f597647282e5 tempest-ProjectMemberTests-1712779975 None] Created reservations ['4e7fedc8-48e6-4772-95c1-d6c72c50cea2', 'b53be664-f4f0-4fa4-805a-e83101063ccd', 'b2b23e5d-a541-4e97-adb8-c5547631aae6', 'dead4a97-1c26-4965-bbb3-554aac11e31c'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:16:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0b864bf3-940d-4c17-b5ac-f597647282e5 tempest-ProjectMemberTests-1712779975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0b864bf3-940d-4c17-b5ac-f597647282e5 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0b864bf3-940d-4c17-b5ac-f597647282e5 tempest-ProjectMemberTests-1712779975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:55 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-0b864bf3-940d-4c17-b5ac-f597647282e5 tempest-ProjectMemberTests-1712779975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-0b864bf3-940d-4c17-b5ac-f597647282e5 tempest-ProjectMemberTests-1712779975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0b864bf3-940d-4c17-b5ac-f597647282e5 tempest-ProjectMemberTests-1712779975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:55 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:16:55 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:55 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:55 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-0b864bf3-940d-4c17-b5ac-f597647282e5 tempest-ProjectMemberTests-1712779975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.271s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:55 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-0b864bf3-940d-4c17-b5ac-f597647282e5 tempest-ProjectMemberTests-1712779975 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:16:55 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-0b864bf3-940d-4c17-b5ac-f597647282e5 tempest-ProjectMemberTests-1712779975 None] Deleted volume successfully. Jul 14 13:16:55 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-0b864bf3-940d-4c17-b5ac-f597647282e5 tempest-ProjectMemberTests-1712779975 None] Lock "cinder-1f935005-92cd-4841-a7b6-25bb5eb58edc-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Flow 'volume_create_manager' (7e676030-1f65-4856-8fac-d2f8e1eb3b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef90f20-f042-4f27-9254-876574407452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef90f20-f042-4f27-9254-876574407452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-511076731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3a63813-4017-402d-8628-cae5bef82f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08bb96f1a21b4ea891e324c2535b402d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:16:59Z,use_quota=True,user_id='138a4dc27d4d4882aec238309cb78cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f16c2fe7-37e7-40da-85ef-3636d194b0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f16c2fe7-37e7-40da-85ef-3636d194b0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c17292a-087b-4c25-996a-5a519a1ca111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c17292a-087b-4c25-996a-5a519a1ca111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3a63813-4017-402d-8628-cae5bef82f6c', 'volume_name': 'volume-c3a63813-4017-402d-8628-cae5bef82f6c', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302a75f6-150a-49ba-8671-f622783fdb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302a75f6-150a-49ba-8671-f622783fdb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d022e0-9725-491b-81b0-27a0f584a888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:16:59 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Volume c3a63813-4017-402d-8628-cae5bef82f6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3a63813-4017-402d-8628-cae5bef82f6c', 'volume_size': 1} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-511076731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3a63813-4017-402d-8628-cae5bef82f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08bb96f1a21b4ea891e324c2535b402d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:16:59Z,use_quota=True,user_id='138a4dc27d4d4882aec238309cb78cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Creating volume c3a63813-4017-402d-8628-cae5bef82f6c {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:16:59 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3a63813-4017-402d-8628-cae5bef82f6c 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:59 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3a63813-4017-402d-8628-cae5bef82f6c 1073741824 Jul 14 13:16:59 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:16:59 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3a63813-4017-402d-8628-cae5bef82f6c 1073741824" returned: 0 in 0.435s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:UPDATE=217,cinder:DELETE=17,cinder:SELECT=163,cinder:INSERT=72 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:UPDATE=221,cinder:SELECT=178,cinder:INSERT=49,cinder:DELETE=18 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:16:59 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3a63813-4017-402d-8628-cae5bef82f6c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:16:59 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3a63813-4017-402d-8628-cae5bef82f6c Jul 14 13:16:59 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:00 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3a63813-4017-402d-8628-cae5bef82f6c" returned: 0 in 0.260s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:00 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:17:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d022e0-9725-491b-81b0-27a0f584a888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3a63813-4017-402d-8628-cae5bef82f6c', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06a237f-9061-4dd4-b4b0-3aa6222e6233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:00 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Volume volume-c3a63813-4017-402d-8628-cae5bef82f6c (c3a63813-4017-402d-8628-cae5bef82f6c): created successfully Jul 14 13:17:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06a237f-9061-4dd4-b4b0-3aa6222e6233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:00 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Flow 'volume_create_manager' (7e676030-1f65-4856-8fac-d2f8e1eb3b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:17:00 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-701b8571-8a22-4898-97c7-ab7d083f6b63 tempest-ProjectReaderTests-462120006 None] Created volume successfully. Jul 14 13:17:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ef8b7f26-23f3-48a6-9693-d0bb48d37b16 tempest-ProjectReaderTests-462120006 None] Acquiring lock "cinder-c3a63813-4017-402d-8628-cae5bef82f6c-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:17:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ef8b7f26-23f3-48a6-9693-d0bb48d37b16 tempest-ProjectReaderTests-462120006 None] Lock "cinder-c3a63813-4017-402d-8628-cae5bef82f6c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:17:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ef8b7f26-23f3-48a6-9693-d0bb48d37b16 tempest-ProjectReaderTests-462120006 None] Acquiring lock "cinder-quobyte-c3a63813-4017-402d-8628-cae5bef82f6c" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:17:00 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ef8b7f26-23f3-48a6-9693-d0bb48d37b16 tempest-ProjectReaderTests-462120006 None] Lock "cinder-quobyte-c3a63813-4017-402d-8628-cae5bef82f6c" acquired by "delete_volume" :: waited 0.015s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:17:00 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[9249cc47-65b9-4850-abaa-91c9e0688ac5]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:17:00 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ef8b7f26-23f3-48a6-9693-d0bb48d37b16 tempest-ProjectReaderTests-462120006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3a63813-4017-402d-8628-cae5bef82f6c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:00 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3a63813-4017-402d-8628-cae5bef82f6c Jul 14 13:17:00 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:01 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ef8b7f26-23f3-48a6-9693-d0bb48d37b16 tempest-ProjectReaderTests-462120006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3a63813-4017-402d-8628-cae5bef82f6c" returned: 0 in 0.370s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ef8b7f26-23f3-48a6-9693-d0bb48d37b16 tempest-ProjectReaderTests-462120006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3a63813-4017-402d-8628-cae5bef82f6c {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:01 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3a63813-4017-402d-8628-cae5bef82f6c Jul 14 13:17:01 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:01 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ef8b7f26-23f3-48a6-9693-d0bb48d37b16 tempest-ProjectReaderTests-462120006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-c3a63813-4017-402d-8628-cae5bef82f6c" returned: 0 in 0.248s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:01 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ef8b7f26-23f3-48a6-9693-d0bb48d37b16 tempest-ProjectReaderTests-462120006 None] Lock "cinder-quobyte-c3a63813-4017-402d-8628-cae5bef82f6c" released by "delete_volume" :: held 0.666s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:17:01 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-ef8b7f26-23f3-48a6-9693-d0bb48d37b16 tempest-ProjectReaderTests-462120006 None] Created reservations ['507838f8-bfaf-41f9-bbbf-70821cd3c8d4', '9059080d-2a3c-47d0-9ce5-1d5d068a4603', 'c8633cd5-990c-4af5-b8dd-9290774769b3', '052d5f07-012e-4246-ab64-585edb72f892'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:17:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ef8b7f26-23f3-48a6-9693-d0bb48d37b16 tempest-ProjectReaderTests-462120006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ef8b7f26-23f3-48a6-9693-d0bb48d37b16 tempest-ProjectReaderTests-462120006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ef8b7f26-23f3-48a6-9693-d0bb48d37b16 tempest-ProjectReaderTests-462120006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:17:01 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ef8b7f26-23f3-48a6-9693-d0bb48d37b16 tempest-ProjectReaderTests-462120006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:17:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ef8b7f26-23f3-48a6-9693-d0bb48d37b16 tempest-ProjectReaderTests-462120006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ef8b7f26-23f3-48a6-9693-d0bb48d37b16 tempest-ProjectReaderTests-462120006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:01 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:17:01 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:01 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:01 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ef8b7f26-23f3-48a6-9693-d0bb48d37b16 tempest-ProjectReaderTests-462120006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.264s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:01 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-ef8b7f26-23f3-48a6-9693-d0bb48d37b16 tempest-ProjectReaderTests-462120006 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:17:01 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-ef8b7f26-23f3-48a6-9693-d0bb48d37b16 tempest-ProjectReaderTests-462120006 None] Deleted volume successfully. Jul 14 13:17:01 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-ef8b7f26-23f3-48a6-9693-d0bb48d37b16 tempest-ProjectReaderTests-462120006 None] Lock "cinder-c3a63813-4017-402d-8628-cae5bef82f6c-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Flow 'volume_create_manager' (5469a2be-fc56-4dbf-960c-bdff81cafc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e70726-f542-494f-b24b-532662166260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e70726-f542-494f-b24b-532662166260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2022812276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eefe4bf-d312-4a21-aead-d403419f80e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08bb96f1a21b4ea891e324c2535b402d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:17:02Z,use_quota=True,user_id='138a4dc27d4d4882aec238309cb78cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba502ed0-3a50-4f78-bef8-45537f955299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba502ed0-3a50-4f78-bef8-45537f955299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ebc4086-a570-4f8b-97b8-e0bfa4c25e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ebc4086-a570-4f8b-97b8-e0bfa4c25e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eefe4bf-d312-4a21-aead-d403419f80e4', 'volume_name': 'volume-9eefe4bf-d312-4a21-aead-d403419f80e4', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3d09c6-2159-4b62-a919-74a1979a6b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3d09c6-2159-4b62-a919-74a1979a6b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5663e2bd-8f2a-45d1-b128-7b9921d3a5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:02 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Volume 9eefe4bf-d312-4a21-aead-d403419f80e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eefe4bf-d312-4a21-aead-d403419f80e4', 'volume_size': 1} Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2022812276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eefe4bf-d312-4a21-aead-d403419f80e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08bb96f1a21b4ea891e324c2535b402d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:17:02Z,use_quota=True,user_id='138a4dc27d4d4882aec238309cb78cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Creating volume 9eefe4bf-d312-4a21-aead-d403419f80e4 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:17:02 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9eefe4bf-d312-4a21-aead-d403419f80e4 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:02 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9eefe4bf-d312-4a21-aead-d403419f80e4 1073741824 Jul 14 13:17:02 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:02 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9eefe4bf-d312-4a21-aead-d403419f80e4 1073741824" returned: 0 in 0.476s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:02 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9eefe4bf-d312-4a21-aead-d403419f80e4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:02 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9eefe4bf-d312-4a21-aead-d403419f80e4 Jul 14 13:17:02 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:03 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9eefe4bf-d312-4a21-aead-d403419f80e4" returned: 0 in 0.293s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:03 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:17:03 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5663e2bd-8f2a-45d1-b128-7b9921d3a5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eefe4bf-d312-4a21-aead-d403419f80e4', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a129d8-dbb5-4f44-8470-55455f227fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:03 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Volume volume-9eefe4bf-d312-4a21-aead-d403419f80e4 (9eefe4bf-d312-4a21-aead-d403419f80e4): created successfully Jul 14 13:17:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a129d8-dbb5-4f44-8470-55455f227fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:03 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Flow 'volume_create_manager' (5469a2be-fc56-4dbf-960c-bdff81cafc33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:17:03 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-2211f10a-60db-4542-b440-a18b26fb1423 tempest-ProjectReaderTests-462120006 None] Created volume successfully. Jul 14 13:17:04 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-787db81d-cdcd-45fb-8e68-b3e509b393ce tempest-ProjectReaderTests-462120006 None] Acquiring lock "cinder-9eefe4bf-d312-4a21-aead-d403419f80e4-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:17:04 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-787db81d-cdcd-45fb-8e68-b3e509b393ce tempest-ProjectReaderTests-462120006 None] Lock "cinder-9eefe4bf-d312-4a21-aead-d403419f80e4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:17:04 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-787db81d-cdcd-45fb-8e68-b3e509b393ce tempest-ProjectReaderTests-462120006 None] Acquiring lock "cinder-quobyte-9eefe4bf-d312-4a21-aead-d403419f80e4" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:17:04 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-787db81d-cdcd-45fb-8e68-b3e509b393ce tempest-ProjectReaderTests-462120006 None] Lock "cinder-quobyte-9eefe4bf-d312-4a21-aead-d403419f80e4" acquired by "delete_volume" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:17:04 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ac8a71-50f4-4ed4-84e2-cde0723ca11c]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:17:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-787db81d-cdcd-45fb-8e68-b3e509b393ce tempest-ProjectReaderTests-462120006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9eefe4bf-d312-4a21-aead-d403419f80e4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:04 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9eefe4bf-d312-4a21-aead-d403419f80e4 Jul 14 13:17:04 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:04 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-787db81d-cdcd-45fb-8e68-b3e509b393ce tempest-ProjectReaderTests-462120006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9eefe4bf-d312-4a21-aead-d403419f80e4" returned: 0 in 0.410s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:04 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-787db81d-cdcd-45fb-8e68-b3e509b393ce tempest-ProjectReaderTests-462120006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9eefe4bf-d312-4a21-aead-d403419f80e4 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:04 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9eefe4bf-d312-4a21-aead-d403419f80e4 Jul 14 13:17:04 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:05 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-787db81d-cdcd-45fb-8e68-b3e509b393ce tempest-ProjectReaderTests-462120006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-9eefe4bf-d312-4a21-aead-d403419f80e4" returned: 0 in 0.264s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:05 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-787db81d-cdcd-45fb-8e68-b3e509b393ce tempest-ProjectReaderTests-462120006 None] Lock "cinder-quobyte-9eefe4bf-d312-4a21-aead-d403419f80e4" released by "delete_volume" :: held 0.716s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:17:05 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-787db81d-cdcd-45fb-8e68-b3e509b393ce tempest-ProjectReaderTests-462120006 None] Created reservations ['fa12603a-230d-4d7d-ab17-44ac350b7439', 'a7c2d58c-f684-4a2f-9ed7-0c2226bbab29', 'c869c4a7-fd49-4374-a86f-f37f5e7d4735', 'd0c06bd2-e31e-44a5-827e-962b3a04777e'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:17:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-787db81d-cdcd-45fb-8e68-b3e509b393ce tempest-ProjectReaderTests-462120006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-787db81d-cdcd-45fb-8e68-b3e509b393ce tempest-ProjectReaderTests-462120006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-787db81d-cdcd-45fb-8e68-b3e509b393ce tempest-ProjectReaderTests-462120006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:17:05 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-787db81d-cdcd-45fb-8e68-b3e509b393ce tempest-ProjectReaderTests-462120006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:17:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-787db81d-cdcd-45fb-8e68-b3e509b393ce tempest-ProjectReaderTests-462120006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-787db81d-cdcd-45fb-8e68-b3e509b393ce tempest-ProjectReaderTests-462120006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:05 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:17:05 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:05 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:05 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-787db81d-cdcd-45fb-8e68-b3e509b393ce tempest-ProjectReaderTests-462120006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.269s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:05 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-787db81d-cdcd-45fb-8e68-b3e509b393ce tempest-ProjectReaderTests-462120006 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:17:05 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-787db81d-cdcd-45fb-8e68-b3e509b393ce tempest-ProjectReaderTests-462120006 None] Deleted volume successfully. Jul 14 13:17:05 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-787db81d-cdcd-45fb-8e68-b3e509b393ce tempest-ProjectReaderTests-462120006 None] Lock "cinder-9eefe4bf-d312-4a21-aead-d403419f80e4-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:17:09 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:17:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Flow 'volume_create_manager' (74ea703a-6be8-4c19-b48f-362950120605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:17:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5112020-6d38-4e39-87ad-3274802f3aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5112020-6d38-4e39-87ad-3274802f3aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1814821605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a92fb7e41f4adfbd0f3ca0251dd32e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:17:09Z,use_quota=True,user_id='f434d027d459429aa00fc7a58ea6533a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf2ba53-360c-4467-8046-4411ca8a97a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf2ba53-360c-4467-8046-4411ca8a97a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42199f66-ae6c-4999-b051-bf4e1d7711d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42199f66-ae6c-4999-b051-bf4e1d7711d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd', 'volume_name': 'volume-49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce01804-79ed-4f1b-b423-3a73e04d0750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce01804-79ed-4f1b-b423-3a73e04d0750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:09 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f508c5e-b573-4947-9516-48e0a1142559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:09 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Volume 49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd', 'volume_size': 1} Jul 14 13:17:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1814821605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a92fb7e41f4adfbd0f3ca0251dd32e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:17:09Z,use_quota=True,user_id='f434d027d459429aa00fc7a58ea6533a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:17:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Creating volume 49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:17:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:17:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:17:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:09 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:17:09 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:17:09 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:09 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd 1073741824 Jul 14 13:17:09 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:10 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd 1073741824" returned: 0 in 0.514s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:10 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd Jul 14 13:17:10 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:10 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd" returned: 0 in 0.284s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:10 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:17:10 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f508c5e-b573-4947-9516-48e0a1142559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00dba44b-1947-4a3c-a96b-39266f70bcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:10 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Volume volume-49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd (49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd): created successfully Jul 14 13:17:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00dba44b-1947-4a3c-a96b-39266f70bcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:10 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Flow 'volume_create_manager' (74ea703a-6be8-4c19-b48f-362950120605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:17:10 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-f3f5884c-9038-4b23-a38d-7e41fdf01e11 tempest-ProjectReaderTests-1150168827 None] Created volume successfully. Jul 14 13:17:11 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6f79d63f-b28e-465f-b8b3-e5cf10b2b5e8 tempest-ProjectReaderTests-1150168827 None] Acquiring lock "cinder-49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:17:11 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6f79d63f-b28e-465f-b8b3-e5cf10b2b5e8 tempest-ProjectReaderTests-1150168827 None] Lock "cinder-49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:17:11 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6f79d63f-b28e-465f-b8b3-e5cf10b2b5e8 tempest-ProjectReaderTests-1150168827 None] Acquiring lock "cinder-quobyte-49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:17:11 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6f79d63f-b28e-465f-b8b3-e5cf10b2b5e8 tempest-ProjectReaderTests-1150168827 None] Lock "cinder-quobyte-49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd" acquired by "delete_volume" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:17:11 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[9619f73d-1533-4f84-812f-d73e1fec7394]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:17:11 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6f79d63f-b28e-465f-b8b3-e5cf10b2b5e8 tempest-ProjectReaderTests-1150168827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:11 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd Jul 14 13:17:11 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:12 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6f79d63f-b28e-465f-b8b3-e5cf10b2b5e8 tempest-ProjectReaderTests-1150168827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd" returned: 0 in 0.417s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6f79d63f-b28e-465f-b8b3-e5cf10b2b5e8 tempest-ProjectReaderTests-1150168827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:12 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd Jul 14 13:17:12 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:12 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6f79d63f-b28e-465f-b8b3-e5cf10b2b5e8 tempest-ProjectReaderTests-1150168827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd" returned: 0 in 0.302s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:12 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6f79d63f-b28e-465f-b8b3-e5cf10b2b5e8 tempest-ProjectReaderTests-1150168827 None] Lock "cinder-quobyte-49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd" released by "delete_volume" :: held 0.777s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:17:12 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-6f79d63f-b28e-465f-b8b3-e5cf10b2b5e8 tempest-ProjectReaderTests-1150168827 None] Created reservations ['31ca92bc-9c6c-4b45-bafb-788a9cabc249', '3e7128d7-2687-49dd-b0ea-a100bdf1b8ee', '6822fdde-e0d3-495b-a0ac-5e1bf72a31f1', '4ddda5e2-8f74-49d6-b6fe-12a959c970b9'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:17:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6f79d63f-b28e-465f-b8b3-e5cf10b2b5e8 tempest-ProjectReaderTests-1150168827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6f79d63f-b28e-465f-b8b3-e5cf10b2b5e8 tempest-ProjectReaderTests-1150168827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6f79d63f-b28e-465f-b8b3-e5cf10b2b5e8 tempest-ProjectReaderTests-1150168827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:17:12 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-6f79d63f-b28e-465f-b8b3-e5cf10b2b5e8 tempest-ProjectReaderTests-1150168827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:17:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-6f79d63f-b28e-465f-b8b3-e5cf10b2b5e8 tempest-ProjectReaderTests-1150168827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:12 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6f79d63f-b28e-465f-b8b3-e5cf10b2b5e8 tempest-ProjectReaderTests-1150168827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:12 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:17:12 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:13 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-6f79d63f-b28e-465f-b8b3-e5cf10b2b5e8 tempest-ProjectReaderTests-1150168827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.356s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-6f79d63f-b28e-465f-b8b3-e5cf10b2b5e8 tempest-ProjectReaderTests-1150168827 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:17:13 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-6f79d63f-b28e-465f-b8b3-e5cf10b2b5e8 tempest-ProjectReaderTests-1150168827 None] Deleted volume successfully. Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-6f79d63f-b28e-465f-b8b3-e5cf10b2b5e8 tempest-ProjectReaderTests-1150168827 None] Lock "cinder-49e957f0-7dd8-4ec1-a19d-8701ad3cd4bd-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Flow 'volume_create_manager' (861f4cd3-d9cb-41f2-8225-32c6ff3ca3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e953e6f-3937-4dde-a1f4-7a79bc2aa881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e953e6f-3937-4dde-a1f4-7a79bc2aa881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1229503647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d0b491f-d3c8-4dc1-a329-619e220daed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a92fb7e41f4adfbd0f3ca0251dd32e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:17:13Z,use_quota=True,user_id='f434d027d459429aa00fc7a58ea6533a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1d682d-1e0b-4a3f-a750-259a626e8363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1d682d-1e0b-4a3f-a750-259a626e8363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047e97a6-7ec9-4955-96ef-b739ac7ba60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047e97a6-7ec9-4955-96ef-b739ac7ba60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d0b491f-d3c8-4dc1-a329-619e220daed5', 'volume_name': 'volume-2d0b491f-d3c8-4dc1-a329-619e220daed5', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b85fa1-411a-42b6-8662-fd7d4b948a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b85fa1-411a-42b6-8662-fd7d4b948a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49d92b4-247f-4c27-8357-c6e8aee70b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:13 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Volume 2d0b491f-d3c8-4dc1-a329-619e220daed5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d0b491f-d3c8-4dc1-a329-619e220daed5', 'volume_size': 1} Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1229503647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d0b491f-d3c8-4dc1-a329-619e220daed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a92fb7e41f4adfbd0f3ca0251dd32e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:17:13Z,use_quota=True,user_id='f434d027d459429aa00fc7a58ea6533a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Creating volume 2d0b491f-d3c8-4dc1-a329-619e220daed5 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:17:13 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:17:13 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2d0b491f-d3c8-4dc1-a329-619e220daed5 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:13 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2d0b491f-d3c8-4dc1-a329-619e220daed5 1073741824 Jul 14 13:17:13 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:14 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2d0b491f-d3c8-4dc1-a329-619e220daed5 1073741824" returned: 0 in 0.541s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2d0b491f-d3c8-4dc1-a329-619e220daed5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:14 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2d0b491f-d3c8-4dc1-a329-619e220daed5 Jul 14 13:17:14 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:14 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2d0b491f-d3c8-4dc1-a329-619e220daed5" returned: 0 in 0.303s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:14 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:17:14 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49d92b4-247f-4c27-8357-c6e8aee70b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d0b491f-d3c8-4dc1-a329-619e220daed5', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7678a9c-d769-4b1f-aa86-a5289968e0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:14 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Volume volume-2d0b491f-d3c8-4dc1-a329-619e220daed5 (2d0b491f-d3c8-4dc1-a329-619e220daed5): created successfully Jul 14 13:17:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7678a9c-d769-4b1f-aa86-a5289968e0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:14 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Flow 'volume_create_manager' (861f4cd3-d9cb-41f2-8225-32c6ff3ca3bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:17:14 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b7a206c3-cdd0-406c-bda0-5e82b42b01e8 tempest-ProjectReaderTests-1150168827 None] Created volume successfully. Jul 14 13:17:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e25cb62e-8815-4561-ae60-43485af75c45 tempest-ProjectReaderTests-1150168827 None] Acquiring lock "cinder-2d0b491f-d3c8-4dc1-a329-619e220daed5-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:17:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e25cb62e-8815-4561-ae60-43485af75c45 tempest-ProjectReaderTests-1150168827 None] Lock "cinder-2d0b491f-d3c8-4dc1-a329-619e220daed5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:17:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e25cb62e-8815-4561-ae60-43485af75c45 tempest-ProjectReaderTests-1150168827 None] Acquiring lock "cinder-quobyte-2d0b491f-d3c8-4dc1-a329-619e220daed5" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:17:15 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e25cb62e-8815-4561-ae60-43485af75c45 tempest-ProjectReaderTests-1150168827 None] Lock "cinder-quobyte-2d0b491f-d3c8-4dc1-a329-619e220daed5" acquired by "delete_volume" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:17:15 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a09881c-cb82-4927-b0d1-0df9b703b115]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:17:15 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e25cb62e-8815-4561-ae60-43485af75c45 tempest-ProjectReaderTests-1150168827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2d0b491f-d3c8-4dc1-a329-619e220daed5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:15 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2d0b491f-d3c8-4dc1-a329-619e220daed5 Jul 14 13:17:15 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:16 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e25cb62e-8815-4561-ae60-43485af75c45 tempest-ProjectReaderTests-1150168827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2d0b491f-d3c8-4dc1-a329-619e220daed5" returned: 0 in 0.410s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e25cb62e-8815-4561-ae60-43485af75c45 tempest-ProjectReaderTests-1150168827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2d0b491f-d3c8-4dc1-a329-619e220daed5 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:16 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2d0b491f-d3c8-4dc1-a329-619e220daed5 Jul 14 13:17:16 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:16 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e25cb62e-8815-4561-ae60-43485af75c45 tempest-ProjectReaderTests-1150168827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-2d0b491f-d3c8-4dc1-a329-619e220daed5" returned: 0 in 0.269s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e25cb62e-8815-4561-ae60-43485af75c45 tempest-ProjectReaderTests-1150168827 None] Lock "cinder-quobyte-2d0b491f-d3c8-4dc1-a329-619e220daed5" released by "delete_volume" :: held 0.731s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-e25cb62e-8815-4561-ae60-43485af75c45 tempest-ProjectReaderTests-1150168827 None] Created reservations ['f0373cb0-0823-42d5-a41e-a874dba398eb', 'c29ffdb5-64a6-4100-9f3a-b4c83c4b288c', 'd3795236-ba89-46e4-a264-c38f9f9d5cb4', 'a0538d42-cf45-4a21-9728-62736bd59ad5'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e25cb62e-8815-4561-ae60-43485af75c45 tempest-ProjectReaderTests-1150168827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e25cb62e-8815-4561-ae60-43485af75c45 tempest-ProjectReaderTests-1150168827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e25cb62e-8815-4561-ae60-43485af75c45 tempest-ProjectReaderTests-1150168827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-e25cb62e-8815-4561-ae60-43485af75c45 tempest-ProjectReaderTests-1150168827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-e25cb62e-8815-4561-ae60-43485af75c45 tempest-ProjectReaderTests-1150168827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e25cb62e-8815-4561-ae60-43485af75c45 tempest-ProjectReaderTests-1150168827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:16 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:17:16 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:16 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:17:16 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:16 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-8442cabb-a838-4242-949b-716181c8c55b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.346s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG oslo_service.periodic_task [None req-8442cabb-a838-4242-949b-716181c8c55b None None] Running periodic task VolumeManager._thread_info {{(pid=86977) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread count: 29 {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-8442cabb-a838-4242-949b-716181c8c55b None None] thread info: [<_MainThread(MainThread, started 140171969769600)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86977) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 13:17:16 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-e25cb62e-8815-4561-ae60-43485af75c45 tempest-ProjectReaderTests-1150168827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.346s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-e25cb62e-8815-4561-ae60-43485af75c45 tempest-ProjectReaderTests-1150168827 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:17:16 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-e25cb62e-8815-4561-ae60-43485af75c45 tempest-ProjectReaderTests-1150168827 None] Deleted volume successfully. Jul 14 13:17:16 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-e25cb62e-8815-4561-ae60-43485af75c45 tempest-ProjectReaderTests-1150168827 None] Lock "cinder-2d0b491f-d3c8-4dc1-a329-619e220daed5-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Flow 'volume_create_manager' (20966ae9-e55f-40fe-ad0c-641cb5099205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5545fa39-b37e-4ccc-b7b3-59ed7becfa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5545fa39-b37e-4ccc-b7b3-59ed7becfa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1781294416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a92fb7e41f4adfbd0f3ca0251dd32e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:17:17Z,use_quota=True,user_id='f434d027d459429aa00fc7a58ea6533a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd16f52-55c8-4c51-bba2-b4f3b170006c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd16f52-55c8-4c51-bba2-b4f3b170006c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581f2459-fa18-4d02-ba10-83ff992cdc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581f2459-fa18-4d02-ba10-83ff992cdc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6', 'volume_name': 'volume-6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60578327-6257-49fe-963f-a1cb85433395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60578327-6257-49fe-963f-a1cb85433395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c39d6c1-86d8-4b6c-b999-dabce9ff02ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:17 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Volume 6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6', 'volume_size': 1} Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1781294416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a92fb7e41f4adfbd0f3ca0251dd32e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:17:17Z,use_quota=True,user_id='f434d027d459429aa00fc7a58ea6533a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Creating volume 6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:17:17 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:17 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6 1073741824 Jul 14 13:17:17 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:17 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6 1073741824" returned: 0 in 0.454s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:17 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:17 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6 Jul 14 13:17:17 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:18 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6" returned: 0 in 0.266s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:18 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:17:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c39d6c1-86d8-4b6c-b999-dabce9ff02ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2cc2c44-3dde-4cc4-8d00-37937b91aac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:18 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Volume volume-6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6 (6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6): created successfully Jul 14 13:17:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2cc2c44-3dde-4cc4-8d00-37937b91aac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:18 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Flow 'volume_create_manager' (20966ae9-e55f-40fe-ad0c-641cb5099205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:17:18 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-ced973b0-4279-4c7b-8994-7b64d04b1b34 tempest-ProjectReaderTests-1150168827 None] Created volume successfully. Jul 14 13:17:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-cc75b3fa-6fff-47aa-bb2f-3183dce4d5e2 tempest-ProjectReaderTests-1150168827 None] Acquiring lock "cinder-6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:17:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-cc75b3fa-6fff-47aa-bb2f-3183dce4d5e2 tempest-ProjectReaderTests-1150168827 None] Lock "cinder-6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:17:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-cc75b3fa-6fff-47aa-bb2f-3183dce4d5e2 tempest-ProjectReaderTests-1150168827 None] Acquiring lock "cinder-quobyte-6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:17:18 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-cc75b3fa-6fff-47aa-bb2f-3183dce4d5e2 tempest-ProjectReaderTests-1150168827 None] Lock "cinder-quobyte-6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6" acquired by "delete_volume" :: waited 0.015s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:17:18 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1ad421-f51b-49e3-8468-cc923f6a4b72]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:17:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cc75b3fa-6fff-47aa-bb2f-3183dce4d5e2 tempest-ProjectReaderTests-1150168827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:18 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6 Jul 14 13:17:18 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:18 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cc75b3fa-6fff-47aa-bb2f-3183dce4d5e2 tempest-ProjectReaderTests-1150168827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6" returned: 0 in 0.383s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:18 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cc75b3fa-6fff-47aa-bb2f-3183dce4d5e2 tempest-ProjectReaderTests-1150168827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:18 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6 Jul 14 13:17:18 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:19 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cc75b3fa-6fff-47aa-bb2f-3183dce4d5e2 tempest-ProjectReaderTests-1150168827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6" returned: 0 in 0.284s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-cc75b3fa-6fff-47aa-bb2f-3183dce4d5e2 tempest-ProjectReaderTests-1150168827 None] Lock "cinder-quobyte-6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6" released by "delete_volume" :: held 0.711s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:17:19 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-cc75b3fa-6fff-47aa-bb2f-3183dce4d5e2 tempest-ProjectReaderTests-1150168827 None] Created reservations ['48867163-93a4-45ef-97ab-c9e1a5a5e95e', '1006d4d2-9481-442e-9e01-3080010aae89', 'b19e3c93-2069-4fcc-95e8-637d95ed0b8b', '6aab8eab-c927-4d3b-9238-4474ecd8a281'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:17:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-cc75b3fa-6fff-47aa-bb2f-3183dce4d5e2 tempest-ProjectReaderTests-1150168827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-cc75b3fa-6fff-47aa-bb2f-3183dce4d5e2 tempest-ProjectReaderTests-1150168827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-cc75b3fa-6fff-47aa-bb2f-3183dce4d5e2 tempest-ProjectReaderTests-1150168827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:17:19 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-cc75b3fa-6fff-47aa-bb2f-3183dce4d5e2 tempest-ProjectReaderTests-1150168827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:17:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-cc75b3fa-6fff-47aa-bb2f-3183dce4d5e2 tempest-ProjectReaderTests-1150168827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cc75b3fa-6fff-47aa-bb2f-3183dce4d5e2 tempest-ProjectReaderTests-1150168827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:19 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:17:19 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:19 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:19 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-cc75b3fa-6fff-47aa-bb2f-3183dce4d5e2 tempest-ProjectReaderTests-1150168827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.264s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:19 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-cc75b3fa-6fff-47aa-bb2f-3183dce4d5e2 tempest-ProjectReaderTests-1150168827 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:17:19 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-cc75b3fa-6fff-47aa-bb2f-3183dce4d5e2 tempest-ProjectReaderTests-1150168827 None] Deleted volume successfully. Jul 14 13:17:19 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-cc75b3fa-6fff-47aa-bb2f-3183dce4d5e2 tempest-ProjectReaderTests-1150168827 None] Lock "cinder-6cbc645e-9c22-43f3-8ed6-7d1d4ab21ca6-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Flow 'volume_create_manager' (9cdcfeaa-39af-4930-9946-aaedf1d8bfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ae11850-e920-4450-b5ac-16a279d1a677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ae11850-e920-4450-b5ac-16a279d1a677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1288242744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=266afc62-a0a8-4c52-95f6-32c4055cc87b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a92fb7e41f4adfbd0f3ca0251dd32e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:17:20Z,use_quota=True,user_id='f434d027d459429aa00fc7a58ea6533a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a148f95a-9e9d-49a2-a152-6a4422b5b1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a148f95a-9e9d-49a2-a152-6a4422b5b1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299ca5af-2c90-4de8-bfa8-c0b969258b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299ca5af-2c90-4de8-bfa8-c0b969258b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '266afc62-a0a8-4c52-95f6-32c4055cc87b', 'volume_name': 'volume-266afc62-a0a8-4c52-95f6-32c4055cc87b', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf211ef-4be7-4c17-9126-90e737c1a204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf211ef-4be7-4c17-9126-90e737c1a204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625d0075-eab0-4e1c-8ebf-2717c9183ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:20 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Volume 266afc62-a0a8-4c52-95f6-32c4055cc87b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-266afc62-a0a8-4c52-95f6-32c4055cc87b', 'volume_size': 1} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1288242744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=266afc62-a0a8-4c52-95f6-32c4055cc87b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a92fb7e41f4adfbd0f3ca0251dd32e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:17:20Z,use_quota=True,user_id='f434d027d459429aa00fc7a58ea6533a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Creating volume 266afc62-a0a8-4c52-95f6-32c4055cc87b {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:17:20 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266afc62-a0a8-4c52-95f6-32c4055cc87b 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:20 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266afc62-a0a8-4c52-95f6-32c4055cc87b 1073741824 Jul 14 13:17:20 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:20 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266afc62-a0a8-4c52-95f6-32c4055cc87b 1073741824" returned: 0 in 0.486s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266afc62-a0a8-4c52-95f6-32c4055cc87b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:20 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266afc62-a0a8-4c52-95f6-32c4055cc87b Jul 14 13:17:20 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:20 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266afc62-a0a8-4c52-95f6-32c4055cc87b" returned: 0 in 0.248s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:17:20 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625d0075-eab0-4e1c-8ebf-2717c9183ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-266afc62-a0a8-4c52-95f6-32c4055cc87b', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab3f166-5db7-4fe1-b8e0-1cb35c5b9ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:21 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Volume volume-266afc62-a0a8-4c52-95f6-32c4055cc87b (266afc62-a0a8-4c52-95f6-32c4055cc87b): created successfully Jul 14 13:17:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab3f166-5db7-4fe1-b8e0-1cb35c5b9ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:21 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Flow 'volume_create_manager' (9cdcfeaa-39af-4930-9946-aaedf1d8bfae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:17:21 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-9e211de1-225e-4225-ba84-d4a61e553211 tempest-ProjectReaderTests-1150168827 None] Created volume successfully. Jul 14 13:17:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4c41b75d-703e-42de-bd39-32ef97094d5e tempest-ProjectReaderTests-1150168827 None] Acquiring lock "cinder-266afc62-a0a8-4c52-95f6-32c4055cc87b-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:17:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4c41b75d-703e-42de-bd39-32ef97094d5e tempest-ProjectReaderTests-1150168827 None] Lock "cinder-266afc62-a0a8-4c52-95f6-32c4055cc87b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:17:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4c41b75d-703e-42de-bd39-32ef97094d5e tempest-ProjectReaderTests-1150168827 None] Acquiring lock "cinder-quobyte-266afc62-a0a8-4c52-95f6-32c4055cc87b" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:17:22 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4c41b75d-703e-42de-bd39-32ef97094d5e tempest-ProjectReaderTests-1150168827 None] Lock "cinder-quobyte-266afc62-a0a8-4c52-95f6-32c4055cc87b" acquired by "delete_volume" :: waited 0.019s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:17:22 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06109ca-3161-47ca-b16e-cf02b0e2e33f]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:17:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4c41b75d-703e-42de-bd39-32ef97094d5e tempest-ProjectReaderTests-1150168827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266afc62-a0a8-4c52-95f6-32c4055cc87b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:22 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266afc62-a0a8-4c52-95f6-32c4055cc87b Jul 14 13:17:22 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:22 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4c41b75d-703e-42de-bd39-32ef97094d5e tempest-ProjectReaderTests-1150168827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266afc62-a0a8-4c52-95f6-32c4055cc87b" returned: 0 in 0.422s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:22 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4c41b75d-703e-42de-bd39-32ef97094d5e tempest-ProjectReaderTests-1150168827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266afc62-a0a8-4c52-95f6-32c4055cc87b {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:22 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266afc62-a0a8-4c52-95f6-32c4055cc87b Jul 14 13:17:22 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:23 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4c41b75d-703e-42de-bd39-32ef97094d5e tempest-ProjectReaderTests-1150168827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-266afc62-a0a8-4c52-95f6-32c4055cc87b" returned: 0 in 0.269s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4c41b75d-703e-42de-bd39-32ef97094d5e tempest-ProjectReaderTests-1150168827 None] Lock "cinder-quobyte-266afc62-a0a8-4c52-95f6-32c4055cc87b" released by "delete_volume" :: held 0.745s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:17:23 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-4c41b75d-703e-42de-bd39-32ef97094d5e tempest-ProjectReaderTests-1150168827 None] Created reservations ['6c1ab0de-f7e6-4b38-a81a-793a9cfe678c', '05a772de-f211-48e3-a5bd-f888bbb7098c', '0ae22eff-1fb0-4174-b389-61fb0ac8f500', '60acde01-5a9b-4f5b-a160-764f5c0834cd'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:17:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4c41b75d-703e-42de-bd39-32ef97094d5e tempest-ProjectReaderTests-1150168827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4c41b75d-703e-42de-bd39-32ef97094d5e tempest-ProjectReaderTests-1150168827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4c41b75d-703e-42de-bd39-32ef97094d5e tempest-ProjectReaderTests-1150168827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:17:23 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-4c41b75d-703e-42de-bd39-32ef97094d5e tempest-ProjectReaderTests-1150168827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:17:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-4c41b75d-703e-42de-bd39-32ef97094d5e tempest-ProjectReaderTests-1150168827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4c41b75d-703e-42de-bd39-32ef97094d5e tempest-ProjectReaderTests-1150168827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:23 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:17:23 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:23 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:23 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-4c41b75d-703e-42de-bd39-32ef97094d5e tempest-ProjectReaderTests-1150168827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.258s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:23 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-4c41b75d-703e-42de-bd39-32ef97094d5e tempest-ProjectReaderTests-1150168827 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:17:23 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-4c41b75d-703e-42de-bd39-32ef97094d5e tempest-ProjectReaderTests-1150168827 None] Deleted volume successfully. Jul 14 13:17:23 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-4c41b75d-703e-42de-bd39-32ef97094d5e tempest-ProjectReaderTests-1150168827 None] Lock "cinder-266afc62-a0a8-4c52-95f6-32c4055cc87b-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:17:24 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:17:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Flow 'volume_create_manager' (6877118b-dba9-4362-87ad-d161e1b6fbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:17:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae383633-f2f1-4a3e-99dd-264d325b0945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae383633-f2f1-4a3e-99dd-264d325b0945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-617865047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=372da68d-e843-4567-87d9-37a422d2e4c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e9609230a7489a9ed1b715d0752c94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:17:25Z,use_quota=True,user_id='6ce5e6da7844438ca86d76223c7f24fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3cf097b-e7a5-4747-bd92-002e81ed5648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3cf097b-e7a5-4747-bd92-002e81ed5648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6802c883-4e62-4171-942e-8dfb46029509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6802c883-4e62-4171-942e-8dfb46029509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '372da68d-e843-4567-87d9-37a422d2e4c1', 'volume_name': 'volume-372da68d-e843-4567-87d9-37a422d2e4c1', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4159340c-dd9f-42c8-875b-33897c16639d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4159340c-dd9f-42c8-875b-33897c16639d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:24 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (224c0d22-8747-4859-aefc-1caad86b6e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:24 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Volume 372da68d-e843-4567-87d9-37a422d2e4c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-372da68d-e843-4567-87d9-37a422d2e4c1', 'volume_size': 1} Jul 14 13:17:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-617865047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=372da68d-e843-4567-87d9-37a422d2e4c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e9609230a7489a9ed1b715d0752c94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:17:25Z,use_quota=True,user_id='6ce5e6da7844438ca86d76223c7f24fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)}" {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 13:17:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Creating volume 372da68d-e843-4567-87d9-37a422d2e4c1 {{(pid=86977) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 13:17:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:24 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:24 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:17:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:17:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:17:25 devstack cinder-volume[86977]: INFO cinder.volume.drivers.remotefs [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] casted to osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 Jul 14 13:17:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1 1073741824 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:25 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1 1073741824 Jul 14 13:17:25 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:25 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1 1073741824" returned: 0 in 0.543s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:25 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1 Jul 14 13:17:25 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:25 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1" returned: 0 in 0.290s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:25 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'} {{(pid=86977) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 13:17:25 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (224c0d22-8747-4859-aefc-1caad86b6e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-372da68d-e843-4567-87d9-37a422d2e4c1', 'volume_size': 1}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32dbf923-2ab1-4d0b-87ac-8bc133fe9e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:25 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Volume volume-372da68d-e843-4567-87d9-37a422d2e4c1 (372da68d-e843-4567-87d9-37a422d2e4c1): created successfully Jul 14 13:17:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32dbf923-2ab1-4d0b-87ac-8bc133fe9e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:25 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Flow 'volume_create_manager' (6877118b-dba9-4362-87ad-d161e1b6fbf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:17:25 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-9bcd4248-8385-48e3-98dd-dd442c08f38e tempest-SnapshotDependencyTests-741485156 None] Created volume successfully. Jul 14 13:17:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2576c6ce-3e42-4366-a8ee-7ac80fae202b tempest-SnapshotDependencyTests-741485156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2576c6ce-3e42-4366-a8ee-7ac80fae202b tempest-SnapshotDependencyTests-741485156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:27 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-2576c6ce-3e42-4366-a8ee-7ac80fae202b tempest-SnapshotDependencyTests-741485156 None] Creating offline snapshot 5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6 of volume 372da68d-e843-4567-87d9-37a422d2e4c1 {{(pid=86977) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 13:17:27 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a97af4-6e69-4e14-8188-185a66f912b9]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:17:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2576c6ce-3e42-4366-a8ee-7ac80fae202b tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:27 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1 Jul 14 13:17:27 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:27 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2576c6ce-3e42-4366-a8ee-7ac80fae202b tempest-SnapshotDependencyTests-741485156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1" returned: 0 in 0.362s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:27 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2576c6ce-3e42-4366-a8ee-7ac80fae202b tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6 1G {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:27 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6 1G Jul 14 13:17:27 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:27 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2576c6ce-3e42-4366-a8ee-7ac80fae202b tempest-SnapshotDependencyTests-741485156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6 1G" returned: 0 in 0.386s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2576c6ce-3e42-4366-a8ee-7ac80fae202b tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-372da68d-e843-4567-87d9-37a422d2e4c1 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:28 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-372da68d-e843-4567-87d9-37a422d2e4c1 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6 Jul 14 13:17:28 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:28 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2576c6ce-3e42-4366-a8ee-7ac80fae202b tempest-SnapshotDependencyTests-741485156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-372da68d-e843-4567-87d9-37a422d2e4c1 -F qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6" returned: 0 in 0.289s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:28 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-2576c6ce-3e42-4366-a8ee-7ac80fae202b tempest-SnapshotDependencyTests-741485156 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6 is being set with open permissions: ugo+rw Jul 14 13:17:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2576c6ce-3e42-4366-a8ee-7ac80fae202b tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:28 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6 Jul 14 13:17:28 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:28 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2576c6ce-3e42-4366-a8ee-7ac80fae202b tempest-SnapshotDependencyTests-741485156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6" returned: 0 in 0.256s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2576c6ce-3e42-4366-a8ee-7ac80fae202b tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:28 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.info Jul 14 13:17:28 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:28 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2576c6ce-3e42-4366-a8ee-7ac80fae202b tempest-SnapshotDependencyTests-741485156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.info" returned: 0 in 0.259s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:28 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-2576c6ce-3e42-4366-a8ee-7ac80fae202b tempest-SnapshotDependencyTests-741485156 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.info is being set with open permissions: ugo+rw Jul 14 13:17:28 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2576c6ce-3e42-4366-a8ee-7ac80fae202b tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.info {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:28 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.info Jul 14 13:17:28 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:29 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-2576c6ce-3e42-4366-a8ee-7ac80fae202b tempest-SnapshotDependencyTests-741485156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.info" returned: 0 in 0.246s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-2576c6ce-3e42-4366-a8ee-7ac80fae202b tempest-SnapshotDependencyTests-741485156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.893s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:29 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-2576c6ce-3e42-4366-a8ee-7ac80fae202b tempest-SnapshotDependencyTests-741485156 None] Create snapshot completed successfully Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG cinder.volume.flows.manager.create_volume [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86977) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Flow 'volume_create_manager' (d359f847-cefd-447e-aa99-2e1064edc19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341993f5-86a3-4b7e-bb88-f57e9fe676ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341993f5-86a3-4b7e-bb88-f57e9fe676ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T11:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f1d2ee1-07e7-41df-bb88-240427ede307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e9609230a7489a9ed1b715d0752c94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T11:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T11:17:30Z,use_quota=True,user_id='6ce5e6da7844438ca86d76223c7f24fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984e1f4d-9995-4b88-9e95-1b12d7bddfd0),volume_type_id=984e1f4d-9995-4b88-9e95-1b12d7bddfd0)' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820e125a-029c-4a90-80cf-4dc2cde92e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820e125a-029c-4a90-80cf-4dc2cde92e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682b1ac6-08c6-40fa-bbe4-418810ddaa21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682b1ac6-08c6-40fa-bbe4-418810ddaa21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8f1d2ee1-07e7-41df-bb88-240427ede307', 'volume_name': 'volume-8f1d2ee1-07e7-41df-bb88-240427ede307', 'volume_size': 1, 'snapshot_id': '5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6'}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8bb3d87-7b1f-44cf-8488-86a18ef062a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8bb3d87-7b1f-44cf-8488-86a18ef062a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e7cf35-b0bc-4e3a-9023-c54e14ddf1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:29 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Volume 8f1d2ee1-07e7-41df-bb88-240427ede307: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8f1d2ee1-07e7-41df-bb88-240427ede307', 'volume_size': 1, 'snapshot_id': '5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6'} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Acquiring lock "cinder-quobyte-5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6-8f1d2ee1-07e7-41df-bb88-240427ede307" by "_create_volume_from_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Lock "cinder-quobyte-5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6-8f1d2ee1-07e7-41df-bb88-240427ede307" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Creating volume 8f1d2ee1-07e7-41df-bb88-240427ede307 from snapshot 5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6 {{(pid=86977) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Selected osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1 as target Quobyte volume. {{(pid=86977) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Acquiring lock "cinder-quobyte-8f1d2ee1-07e7-41df-bb88-240427ede307" by "_copy_volume_from_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Lock "cinder-quobyte-8f1d2ee1-07e7-41df-bb88-240427ede307" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:17:29 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] snapshot: 5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6, volume: 8f1d2ee1-07e7-41df-bb88-240427ede307, {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 13:17:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:17:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:17:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:30 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee23b103-2325-43a0-a691-b2a8ef35c60e]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:17:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:30 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6 Jul 14 13:17:30 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:30 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6" returned: 0 in 0.363s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-372da68d-e843-4567-87d9-37a422d2e4c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:17:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1 {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 13:17:30 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Creating direct copy from snapshot {{(pid=86977) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 13:17:30 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4cbf60-8e27-4f73-abb7-a2c46a9bccdc]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:17:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:30 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1 Jul 14 13:17:30 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:30 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1" returned: 0 in 0.368s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:30 devstack cinder-volume[86977]: DEBUG cinder.utils [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Path /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8f1d2ee1-07e7-41df-bb88-240427ede307 not found in is_blk_device check {{(pid=86977) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 13:17:30 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8f1d2ee1-07e7-41df-bb88-240427ede307 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:30 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8f1d2ee1-07e7-41df-bb88-240427ede307 Jul 14 13:17:30 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:34 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8f1d2ee1-07e7-41df-bb88-240427ede307" returned: 0 in 4.135s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:34 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[7984a61a-c460-4884-87ea-c1dbe46bbe6a]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:17:34 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:35 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1 Jul 14 13:17:35 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:35 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1" returned: 0 in 0.535s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:35 devstack cinder-volume[86977]: DEBUG cinder.image.image_utils [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Image conversion details: src /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1, size 1024.00 MB, duration 4.14 sec, destination /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8f1d2ee1-07e7-41df-bb88-240427ede307 {{(pid=86977) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:552}} Jul 14 13:17:35 devstack cinder-volume[86977]: INFO cinder.image.image_utils [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Converted 1024.00 MB image at 247.51 MB/s Jul 14 13:17:35 devstack cinder-volume[86977]: WARNING cinder.volume.drivers.remotefs [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8f1d2ee1-07e7-41df-bb88-240427ede307 is being set with open permissions: ugo+rw Jul 14 13:17:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8f1d2ee1-07e7-41df-bb88-240427ede307 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:35 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8f1d2ee1-07e7-41df-bb88-240427ede307 Jul 14 13:17:35 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:35 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8f1d2ee1-07e7-41df-bb88-240427ede307" returned: 0 in 0.254s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:35 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Lock "cinder-quobyte-8f1d2ee1-07e7-41df-bb88-240427ede307" released by "_copy_volume_from_snapshot" :: held 5.745s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:17:35 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Lock "cinder-quobyte-5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6-8f1d2ee1-07e7-41df-bb88-240427ede307" released by "_create_volume_from_snapshot" :: held 5.771s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:17:35 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.790s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e7cf35-b0bc-4e3a-9023-c54e14ddf1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f1d2ee1-07e7-41df-bb88-240427ede307', 'volume_size': 1, 'snapshot_id': '5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6'}' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88d9ca1-0986-45f2-9d2d-2b0fc1fcc279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 13:17:35 devstack cinder-volume[86977]: INFO cinder.volume.flows.manager.create_volume [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Volume volume-8f1d2ee1-07e7-41df-bb88-240427ede307 (8f1d2ee1-07e7-41df-bb88-240427ede307): created successfully Jul 14 13:17:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88d9ca1-0986-45f2-9d2d-2b0fc1fcc279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86977) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 13:17:35 devstack cinder-volume[86977]: DEBUG cinder.volume.manager [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Flow 'volume_create_manager' (d359f847-cefd-447e-aa99-2e1064edc19f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86977) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 13:17:35 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-054d56d0-c7e9-4ab8-b67c-c1e7c32f5731 tempest-SnapshotDependencyTests-741485156 None] Created volume successfully. Jul 14 13:17:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b9f33df0-5f4b-46ec-9f21-10b7aa03fc6e tempest-SnapshotDependencyTests-741485156 None] Acquiring lock "cinder-5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6-delete_snapshot" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:17:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b9f33df0-5f4b-46ec-9f21-10b7aa03fc6e tempest-SnapshotDependencyTests-741485156 None] Lock "cinder-5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:17:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b9f33df0-5f4b-46ec-9f21-10b7aa03fc6e tempest-SnapshotDependencyTests-741485156 None] Acquiring lock "cinder-quobyte-372da68d-e843-4567-87d9-37a422d2e4c1" by "delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:17:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b9f33df0-5f4b-46ec-9f21-10b7aa03fc6e tempest-SnapshotDependencyTests-741485156 None] Lock "cinder-quobyte-372da68d-e843-4567-87d9-37a422d2e4c1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:17:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b9f33df0-5f4b-46ec-9f21-10b7aa03fc6e tempest-SnapshotDependencyTests-741485156 None] Acquiring lock "cinder-quobyte-5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6" by "_delete_snapshot" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:17:36 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b9f33df0-5f4b-46ec-9f21-10b7aa03fc6e tempest-SnapshotDependencyTests-741485156 None] Lock "cinder-quobyte-5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:17:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b9f33df0-5f4b-46ec-9f21-10b7aa03fc6e tempest-SnapshotDependencyTests-741485156 None] Deleting offline snapshot 5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6 of volume 372da68d-e843-4567-87d9-37a422d2e4c1 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 13:17:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b9f33df0-5f4b-46ec-9f21-10b7aa03fc6e tempest-SnapshotDependencyTests-741485156 None] snapshot_file for this snap is: volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6 {{(pid=86977) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 13:17:36 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1d4393-3642-4be7-a27b-d970e337e8c4]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:17:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b9f33df0-5f4b-46ec-9f21-10b7aa03fc6e tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:36 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6 Jul 14 13:17:36 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:36 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b9f33df0-5f4b-46ec-9f21-10b7aa03fc6e tempest-SnapshotDependencyTests-741485156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6" returned: 0 in 0.366s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:36 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.remotefs [None req-b9f33df0-5f4b-46ec-9f21-10b7aa03fc6e tempest-SnapshotDependencyTests-741485156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-372da68d-e843-4567-87d9-37a422d2e4c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86977) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 13:17:36 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cd03da-b79a-46df-9c04-fccd827487c1]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:17:36 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b9f33df0-5f4b-46ec-9f21-10b7aa03fc6e tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:37 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1 Jul 14 13:17:37 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:37 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b9f33df0-5f4b-46ec-9f21-10b7aa03fc6e tempest-SnapshotDependencyTests-741485156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1" returned: 0 in 0.348s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b9f33df0-5f4b-46ec-9f21-10b7aa03fc6e tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:37 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6 Jul 14 13:17:37 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:37 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b9f33df0-5f4b-46ec-9f21-10b7aa03fc6e tempest-SnapshotDependencyTests-741485156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6" returned: 0 in 0.332s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b9f33df0-5f4b-46ec-9f21-10b7aa03fc6e tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:37 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6 Jul 14 13:17:37 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:37 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:37 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b9f33df0-5f4b-46ec-9f21-10b7aa03fc6e tempest-SnapshotDependencyTests-741485156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1.5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6" returned: 0 in 0.246s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b9f33df0-5f4b-46ec-9f21-10b7aa03fc6e tempest-SnapshotDependencyTests-741485156 None] Lock "cinder-quobyte-5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6" released by "_delete_snapshot" :: held 1.387s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:17:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b9f33df0-5f4b-46ec-9f21-10b7aa03fc6e tempest-SnapshotDependencyTests-741485156 None] Lock "cinder-quobyte-372da68d-e843-4567-87d9-37a422d2e4c1" released by "delete_snapshot" :: held 1.407s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:17:37 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-b9f33df0-5f4b-46ec-9f21-10b7aa03fc6e tempest-SnapshotDependencyTests-741485156 None] Created reservations ['14444088-1d29-4471-abf5-96d5d129617e', '97f3e4ff-0614-4bfc-9235-3c407433c871', 'b6e72ba4-d4cd-407a-a4d3-fd8279b2ec77', '2d2a9824-f8d4-41d4-93f2-16d6b16a8e41'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:17:37 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b9f33df0-5f4b-46ec-9f21-10b7aa03fc6e tempest-SnapshotDependencyTests-741485156 None] Delete snapshot completed successfully. Jul 14 13:17:37 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b9f33df0-5f4b-46ec-9f21-10b7aa03fc6e tempest-SnapshotDependencyTests-741485156 None] Lock "cinder-5ac3cee6-5ad4-488d-80ec-3eaa6d0072d6-delete_snapshot" released by "delete_snapshot" :: held 1.528s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:17:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-faff8d54-09ee-4e6d-8f37-92d463082ea8 tempest-SnapshotDependencyTests-741485156 None] Acquiring lock "cinder-372da68d-e843-4567-87d9-37a422d2e4c1-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:17:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-faff8d54-09ee-4e6d-8f37-92d463082ea8 tempest-SnapshotDependencyTests-741485156 None] Lock "cinder-372da68d-e843-4567-87d9-37a422d2e4c1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:17:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-faff8d54-09ee-4e6d-8f37-92d463082ea8 tempest-SnapshotDependencyTests-741485156 None] Acquiring lock "cinder-quobyte-372da68d-e843-4567-87d9-37a422d2e4c1" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:17:38 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-faff8d54-09ee-4e6d-8f37-92d463082ea8 tempest-SnapshotDependencyTests-741485156 None] Lock "cinder-quobyte-372da68d-e843-4567-87d9-37a422d2e4c1" acquired by "delete_volume" :: waited 0.017s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:17:38 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[d230136e-c8a1-4ab5-b219-2387e3a9420a]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:17:38 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-faff8d54-09ee-4e6d-8f37-92d463082ea8 tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:38 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1 Jul 14 13:17:38 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:39 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-faff8d54-09ee-4e6d-8f37-92d463082ea8 tempest-SnapshotDependencyTests-741485156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1" returned: 0 in 0.357s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-faff8d54-09ee-4e6d-8f37-92d463082ea8 tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:39 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1 Jul 14 13:17:39 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:39 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-faff8d54-09ee-4e6d-8f37-92d463082ea8 tempest-SnapshotDependencyTests-741485156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-372da68d-e843-4567-87d9-37a422d2e4c1" returned: 0 in 0.241s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-faff8d54-09ee-4e6d-8f37-92d463082ea8 tempest-SnapshotDependencyTests-741485156 None] Lock "cinder-quobyte-372da68d-e843-4567-87d9-37a422d2e4c1" released by "delete_volume" :: held 0.654s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:17:39 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-faff8d54-09ee-4e6d-8f37-92d463082ea8 tempest-SnapshotDependencyTests-741485156 None] Created reservations ['2c6ef409-780e-4875-b9d4-e50b5a82ef69', '7f64e3b8-17f7-42b5-8720-f7afa44d434d', 'efb11fdb-ab9c-4361-9d50-c627eb0852fd', '35a80713-4d30-4894-a370-9ec476c22417'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:17:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-faff8d54-09ee-4e6d-8f37-92d463082ea8 tempest-SnapshotDependencyTests-741485156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-faff8d54-09ee-4e6d-8f37-92d463082ea8 tempest-SnapshotDependencyTests-741485156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:39 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-faff8d54-09ee-4e6d-8f37-92d463082ea8 tempest-SnapshotDependencyTests-741485156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:17:39 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-faff8d54-09ee-4e6d-8f37-92d463082ea8 tempest-SnapshotDependencyTests-741485156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:17:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-faff8d54-09ee-4e6d-8f37-92d463082ea8 tempest-SnapshotDependencyTests-741485156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-faff8d54-09ee-4e6d-8f37-92d463082ea8 tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:39 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:17:39 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:39 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-faff8d54-09ee-4e6d-8f37-92d463082ea8 tempest-SnapshotDependencyTests-741485156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.246s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:39 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-faff8d54-09ee-4e6d-8f37-92d463082ea8 tempest-SnapshotDependencyTests-741485156 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:17:39 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-faff8d54-09ee-4e6d-8f37-92d463082ea8 tempest-SnapshotDependencyTests-741485156 None] Deleted volume successfully. Jul 14 13:17:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-faff8d54-09ee-4e6d-8f37-92d463082ea8 tempest-SnapshotDependencyTests-741485156 None] Lock "cinder-372da68d-e843-4567-87d9-37a422d2e4c1-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:17:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b87c6e51-7b6a-45c1-9f57-275d69c6cee0 tempest-SnapshotDependencyTests-741485156 None] Acquiring lock "cinder-8f1d2ee1-07e7-41df-bb88-240427ede307-delete_volume" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:17:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b87c6e51-7b6a-45c1-9f57-275d69c6cee0 tempest-SnapshotDependencyTests-741485156 None] Lock "cinder-8f1d2ee1-07e7-41df-bb88-240427ede307-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:17:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b87c6e51-7b6a-45c1-9f57-275d69c6cee0 tempest-SnapshotDependencyTests-741485156 None] Acquiring lock "cinder-quobyte-8f1d2ee1-07e7-41df-bb88-240427ede307" by "delete_volume" {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 13:17:39 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b87c6e51-7b6a-45c1-9f57-275d69c6cee0 tempest-SnapshotDependencyTests-741485156 None] Lock "cinder-quobyte-8f1d2ee1-07e7-41df-bb88-240427ede307" acquired by "delete_volume" :: waited 0.024s {{(pid=86977) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 13:17:39 devstack cinder-volume[86977]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e68c3a-5c18-42bf-982b-8426e66f2b86]: (4, 'qcow2') {{(pid=88743) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 13:17:39 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b87c6e51-7b6a-45c1-9f57-275d69c6cee0 tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8f1d2ee1-07e7-41df-bb88-240427ede307 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:39 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8f1d2ee1-07e7-41df-bb88-240427ede307 Jul 14 13:17:39 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:40 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b87c6e51-7b6a-45c1-9f57-275d69c6cee0 tempest-SnapshotDependencyTests-741485156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8f1d2ee1-07e7-41df-bb88-240427ede307" returned: 0 in 0.353s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b87c6e51-7b6a-45c1-9f57-275d69c6cee0 tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8f1d2ee1-07e7-41df-bb88-240427ede307 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:40 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8f1d2ee1-07e7-41df-bb88-240427ede307 Jul 14 13:17:40 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:40 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b87c6e51-7b6a-45c1-9f57-275d69c6cee0 tempest-SnapshotDependencyTests-741485156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132/volume-8f1d2ee1-07e7-41df-bb88-240427ede307" returned: 0 in 0.249s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:40 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b87c6e51-7b6a-45c1-9f57-275d69c6cee0 tempest-SnapshotDependencyTests-741485156 None] Lock "cinder-quobyte-8f1d2ee1-07e7-41df-bb88-240427ede307" released by "delete_volume" :: held 0.640s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:17:40 devstack cinder-volume[86977]: DEBUG cinder.quota [None req-b87c6e51-7b6a-45c1-9f57-275d69c6cee0 tempest-SnapshotDependencyTests-741485156 None] Created reservations ['ca1c6bb6-3f2e-49e3-8c44-f40936684f5d', 'bfb0de1d-f888-413a-8577-7487a3e6b15a', '19bd5bef-d670-4914-ba00-e11c288ddcab', '0d33571b-6e70-4580-a57a-1e6651e9e2bd'] {{(pid=86977) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 13:17:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b87c6e51-7b6a-45c1-9f57-275d69c6cee0 tempest-SnapshotDependencyTests-741485156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 13:17:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b87c6e51-7b6a-45c1-9f57-275d69c6cee0 tempest-SnapshotDependencyTests-741485156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 13:17:40 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b87c6e51-7b6a-45c1-9f57-275d69c6cee0 tempest-SnapshotDependencyTests-741485156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1': None} {{(pid=86977) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 13:17:40 devstack cinder-volume[86977]: DEBUG cinder.volume.drivers.quobyte [None req-b87c6e51-7b6a-45c1-9f57-275d69c6cee0 tempest-SnapshotDependencyTests-741485156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5305ce97-ea21-4e9c-a6d2-98be88eb92f1'] {{(pid=86977) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 13:17:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.lockutils [None req-b87c6e51-7b6a-45c1-9f57-275d69c6cee0 tempest-SnapshotDependencyTests-741485156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86977) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 13:17:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b87c6e51-7b6a-45c1-9f57-275d69c6cee0 tempest-SnapshotDependencyTests-741485156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 13:17:40 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132 Jul 14 13:17:40 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 13:17:40 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Jul 14 13:17:40 devstack cinder-volume[86977]: DEBUG oslo_concurrency.processutils [None req-b87c6e51-7b6a-45c1-9f57-275d69c6cee0 tempest-SnapshotDependencyTests-741485156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0fe8e8a4d08f52b884440ad5f91d3132" returned: 0 in 0.271s {{(pid=86977) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 13:17:40 devstack cinder-volume[86977]: DEBUG cinder.manager [None req-b87c6e51-7b6a-45c1-9f57-275d69c6cee0 tempest-SnapshotDependencyTests-741485156 None] Notifying Schedulers of capabilities ... {{(pid=86977) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 13:17:40 devstack cinder-volume[86977]: INFO cinder.volume.manager [None req-b87c6e51-7b6a-45c1-9f57-275d69c6cee0 tempest-SnapshotDependencyTests-741485156 None] Deleted volume successfully. Jul 14 13:17:40 devstack cinder-volume[86977]: DEBUG cinder.coordination [None req-b87c6e51-7b6a-45c1-9f57-275d69c6cee0 tempest-SnapshotDependencyTests-741485156 None] Lock "cinder-8f1d2ee1-07e7-41df-bb88-240427ede307-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=86977) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 13:17:50 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:UPDATE=92,cinder:DELETE=8,cinder:SELECT=66,cinder:INSERT=20 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 13:17:50 devstack cinder-volume[86977]: DEBUG dbcounter [-] [86977] Writing DB stats cinder:SELECT=62,cinder:INSERT=24,cinder:UPDATE=94,cinder:DELETE=9 {{(pid=86977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}